Jul 15 18:22:42 devstack cinder-volume[76261]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 15 18:22:42 devstack cinder-volume[76261]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 15 18:22:42 devstack cinder-volume[76261]: we strongly recommend against using it for new projects. Jul 15 18:22:42 devstack cinder-volume[76261]: If you are already using Eventlet, we recommend migrating to a different Jul 15 18:22:42 devstack cinder-volume[76261]: framework. For more detail see Jul 15 18:22:42 devstack cinder-volume[76261]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 15 18:22:42 devstack cinder-volume[76261]: import eventlet # noqa Jul 15 18:22:46 devstack cinder-volume[76261]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:22:46 devstack cinder-volume[76261]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:22:46 devstack cinder-volume[76261]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:22:47 devstack cinder-volume[76261]: INFO dbcounter [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Registered counter for database cinder Jul 15 18:22:47 devstack cinder-volume[76261]: DEBUG oslo_db.sqlalchemy.engines [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:22:47 devstack cinder-volume[76261]: DEBUG dbcounter [-] [76261] Writer thread running {{(pid=76261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:22:47 devstack cinder-volume[76261]: INFO cinder.rpc [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 15 18:22:47 devstack cinder-volume[76261]: INFO cinder.rpc [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 15 18:22:47 devstack cinder-volume[76261]: DEBUG oslo_db.sqlalchemy.engines [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:22:47 devstack cinder-volume[76261]: INFO cinder.volume.manager [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Determined volume DB was empty at startup. Jul 15 18:22:47 devstack cinder-volume[76261]: DEBUG cinder.volume.manager [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76261) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 15 18:22:47 devstack cinder-volume[76261]: INFO cinder.volume.manager [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 15 18:22:47 devstack cinder-volume[76261]: WARNING stevedore.named [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 15 18:22:47 devstack cinder-volume[76261]: WARNING castellan.key_manager [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:22:47 devstack cinder-volume[76261]: WARNING cinder.keymgr.conf_key_mgr [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:22:47 devstack cinder-volume[76261]: DEBUG cinder.volume.drivers.lvm [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76261) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 15 18:22:47 devstack cinder-volume[76261]: DEBUG oslo_concurrency.processutils [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_concurrency.processutils [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] CMD "cinder-rtstool verify" returned: 0 in 0.431s {{(pid=76261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_db.sqlalchemy.engines [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:22:48 devstack cinder-volume[76261]: INFO cinder.rpc [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 15 18:22:48 devstack cinder-volume[76261]: INFO cinder.rpc [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 15 18:22:48 devstack cinder-volume[76261]: WARNING stevedore.named [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 15 18:22:48 devstack cinder-volume[76261]: WARNING castellan.key_manager [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:22:48 devstack cinder-volume[76261]: INFO cinder.volume.manager [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_db.sqlalchemy.engines [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:22:48 devstack cinder-volume[76261]: INFO oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Starting 1 workers Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Started child 76398 {{(pid=76261) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Full set of CONF: {{(pid=76261) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] ******************************************************************************** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Configuration options gathered from: {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] ================================================================================ {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] allow_availability_zone_fallback = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] allow_compression_on_image_upload = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] allowed_direct_url_schemes = [] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] api_rate_limit = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] auth_strategy = keystone {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] az_cache_duration = 3600 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_availability_zone = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_host = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_name = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_stats_polling_interval = 60 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backup_api_class = cinder.backup.api.API {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backup_name_template = backup-%s {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backup_use_same_host = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backup_use_temp_snapshot = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] chap_password = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] chap_username = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cinder_internal_tenant_project_id = e1e98578ce004fa9b31081456af4ccac {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cinder_internal_tenant_user_id = 74625daa26964600b64694aac37868a1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cloned_volume_same_az = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cluster = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] compression_format = gzip {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] compute_api_class = cinder.compute.nova.API {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] config_dir = [] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] config_source = [] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] control_exchange = openstack {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] debug = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] default_availability_zone = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] default_group_type = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76398]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] default_volume_type = lvmdriver-1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] disk_geometry = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] driver_client_cert = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] driver_client_cert_key = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] driver_data_namespace = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] driver_ssl_cert_path = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] driver_ssl_cert_verify = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] driver_use_ssl = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] enable_force_upload = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] enable_new_services = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] enable_unsupported_driver = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] enforce_multipath_for_image_xfer = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] filter_function = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance_api_insecure = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance_api_servers = ['http://192.168.122.35/image'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance_api_ssl_compression = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance_ca_certificates_file = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance_catalog_info = image:glance:publicURL {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance_certfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance_keyfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance_num_retries = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance_request_timeout = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] goodness_function = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] graceful_shutdown_timeout = 5 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] group_api_class = cinder.group.api.API {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] host = devstack {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] image_compress_on_upload = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] image_conversion_address_space_limit = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] image_conversion_cpu_limit = 60 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] image_conversion_disable = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] image_upload_use_cinder_backend = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] image_upload_use_internal_tenant = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] image_volume_cache_enabled = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] image_volume_cache_max_count = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] image_volume_cache_max_size_gb = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] init_host_max_objects_retrieval = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] instance_format = [instance: %(uuid)s] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] iscsi_target_flags = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] iscsi_write_cache = on {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] iser_helper = tgtadm {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] iser_ip_address = 192.168.122.35 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] iser_port = 3260 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] log_color = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] log_config_append = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] log_dir = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] log_file = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] log_options = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] log_rotate_interval = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] log_rotate_interval_type = days {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] log_rotation_type = none {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] max_age = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] max_logfile_count = 30 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] max_logfile_size_mb = 200 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] max_over_subscription_ratio = 20.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] message_reap_interval = 86400 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] message_ttl = 2592000 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] migration_create_volume_timeout_secs = 300 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] monkey_patch = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] monkey_patch_modules = [] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] my_ip = 192.168.122.35 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] no_snapshot_gb_quota = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] num_iser_scan_tries = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] num_shell_tries = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] num_volume_device_scan_tries = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] nvmeof_conn_info_version = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] nvmet_ns_id = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] nvmet_port_id = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] osapi_max_limit = 1000 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] osapi_volume_ext_list = [] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] osapi_volume_listen_port = 8776 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] osapi_volume_use_ssl = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] osapi_volume_workers = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] per_volume_size_limit = -1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] periodic_fuzzy_delay = 60 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] periodic_interval = 60 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] public_endpoint = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] publish_errors = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] quota_backup_gigabytes = 1000 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] quota_backups = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] quota_gigabytes = 1000 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] quota_groups = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] quota_snapshots = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] quota_volumes = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] rate_limit_burst = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] rate_limit_except_level = CRITICAL {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] rate_limit_interval = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] reinit_driver_count = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] replication_device = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] report_discard_supported = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] report_interval = 120 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] reservation_clean_interval = 86400 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] reservation_expire = 86400 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] reserved_image_namespaces = [] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] reserved_percentage = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] rpc_response_timeout = 120 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] run_external_periodic_tasks = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] scst_target_driver = iscsi {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] scst_target_iqn_name = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_down_time = 720 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] shell_completion = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] snapshot_name_template = snapshot-%s {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] snapshot_same_host = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] split_loggers = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] state_path = /opt/stack/data/cinder {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] storage_availability_zone = nova {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] storage_protocol = iSCSI {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] syslog_log_facility = LOG_USER {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] target_helper = lioadm {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] target_ip_address = 192.168.122.35 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] target_port = 3260 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] target_protocol = iscsi {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] target_secondary_ip_addresses = [] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] trace_flags = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] transport_url = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] until_refresh = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] use_chap_auth = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] use_default_quota_class = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] use_journal = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] use_json = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] use_multipath_for_image_xfer = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] use_stderr = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] use_syslog = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] verify_glance_signatures = enabled {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76398]: INFO cinder.volume.manager [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_api_class = cinder.volume.api.API {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_backend_name = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_clear = zero {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_clear_ionice = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_clear_size = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_copy_bps_limit = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_dd_blocksize = 1M {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_name_template = volume-%s {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_service_inithost_offload = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volume_usage_audit_period = month {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] zoning_mode = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_concurrency.disable_process_locking = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.auth_section = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.auth_type = password {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.auth_version = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.cache = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.certfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.include_service_catalog = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.insecure = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.interface = public {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.keyfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_password = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcache_username = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.region_name = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.service_type = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.35/identity {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.backend = dogpile.cache.null {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.backend_argument = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.backend_expiration_time = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.config_prefix = cache.oslo {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.debug_cache_backend = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.enable_retry_client = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.enable_socket_keepalive = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.enabled = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.expiration_time = 600 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.hashclient_retry_attempts = 2 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.memcache_dead_retry = 300 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.memcache_pool_maxsize = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.memcache_sasl_enabled = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.password = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.proxies = [] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.redis_db = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.redis_server = localhost:6379 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.retry_attempts = 2 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.retry_delay = 0.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.socket_keepalive_count = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.socket_keepalive_idle = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.socket_keepalive_interval = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.socket_timeout = 1.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.tls_allowed_ciphers = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.tls_cafile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.tls_certfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.tls_enabled = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.tls_keyfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cache.username = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] coordination.backend_url = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.asyncio_connection = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.asyncio_slave_connection = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.backend = sqlalchemy {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.connection = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.connection_debug = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.connection_parameters = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.connection_recycle_time = 3600 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.connection_trace = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.db_inc_retry_interval = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.db_max_retries = 20 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.db_max_retry_interval = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.db_retry_interval = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.max_overflow = 50 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.max_pool_size = 5 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.max_retries = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.mysql_wsrep_sync_wait = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.pool_timeout = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.retry_interval = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.slave_connection = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.sqlite_synchronous = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.synchronous_reader = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] database.use_db_reconnect = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.connection_string = messaging:// {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.enabled = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.es_doc_type = notification {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.es_scroll_size = 10000 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.es_scroll_time = 2m {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.filter_error_trace = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.hmac_keys = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.sentinel_service_name = mymaster {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.socket_timeout = 0.1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.trace_requests = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler.trace_sqlalchemy = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:48 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler_jaeger.process_tags = {} {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler_jaeger.service_name_prefix = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] profiler_otlp.service_name_prefix = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.enforce_new_defaults = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.enforce_scope = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.policy_default_rule = default {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.policy_file = policy.yaml {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] privsep_osbrick.group = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] privsep_osbrick.helper_command = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] privsep_osbrick.user = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cinder_sys_admin.group = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cinder_sys_admin.helper_command = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] cinder_sys_admin.user = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_user.auth_section = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_user.auth_type = password {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_user.cafile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_user.certfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_user.collect_timing = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_user.insecure = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_user.keyfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_user.send_service_user_token = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_user.split_loggers = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] service_user.timeout = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance.auth_section = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance.auth_type = password {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance.certfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance.collect_timing = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance.insecure = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance.keyfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance.region_name = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance.split_loggers = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] glance.timeout = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.backend_availability_zone = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.chap_password = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.chap_username = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.disk_geometry = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.driver_client_cert = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.driver_client_cert_key = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.driver_data_namespace = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.driver_use_ssl = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.extra_capabilities = {} {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.filter_function = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.goodness_function = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.iscsi_target_flags = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.iscsi_write_cache = on {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.iser_helper = tgtadm {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.iser_ip_address = 192.168.122.35 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.iser_port = 3260 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:48 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.lvm_share_target = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.lvm_type = auto {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.num_shell_tries = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.replication_device = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.report_discard_supported = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.reserved_percentage = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.target_helper = tgtadm {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.target_ip_address = 192.168.122.35 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.target_port = 3260 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.target_protocol = iscsi {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.trace_flags = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.unique_fqdn_network = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.use_chap_auth = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.volume_backend_name = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.volume_clear = zero {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.volume_clear_ionice = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.volume_clear_size = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_reports.file_event_handler = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_reports.log_dir = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.backend_host = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.chap_password = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.chap_username = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.disk_geometry = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.driver_client_cert = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.extra_capabilities = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.filter_function = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.goodness_function = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.iser_helper = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.iser_ip_address = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.iser_port = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.lvm_share_target = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.lvm_type = auto {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.num_shell_tries = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.replication_device = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.report_discard_supported = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.reserved_percentage = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.scst_target_driver = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.storage_protocol = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.target_helper = lioadm {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.target_ip_address = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.target_port = 3260 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.trace_flags = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.use_chap_auth = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack sudo[76456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.volume_clear = zero {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.volume_clear_size = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack sudo[76456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] lvmdriver-1.volumes_dir = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.ssl = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_notifications.driver = [] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_notifications.retry = -1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] key_manager.fixed_key = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.barbican_api_version = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.barbican_endpoint = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.barbican_endpoint_type = public {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.barbican_region_name = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.cafile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.certfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.collect_timing = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.insecure = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.keyfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.number_of_retries = 60 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.retry_delay = 1 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.send_service_user_token = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.split_loggers = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.timeout = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.verify_ssl = True {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican.verify_ssl_path = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican_service_user.auth_section = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican_service_user.auth_type = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican_service_user.cafile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican_service_user.certfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican_service_user.collect_timing = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican_service_user.insecure = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican_service_user.keyfile = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican_service_user.split_loggers = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] barbican_service_user.timeout = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.approle_role_id = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.approle_secret_id = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.auth_method = approle {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.auth_path = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.kv_mountpoint = secret {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.kv_path = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.kv_version = 2 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.namespace = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.root_token_id = **** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.ssl_ca_crt_file = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.timeout = 60.0 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.token_file = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.token_role = None {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.use_ssl = False {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:48 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] ******************************************************************************** {{(pid=76261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 15 18:22:48 devstack sudo[76456]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:49 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:49 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:49 devstack sudo[76569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:49 devstack sudo[76569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:49 devstack sudo[76569]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:49 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.280s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:49 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:22:49 devstack cinder-volume[76398]: INFO cinder.brick.local_dev.lvm [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 15 18:22:49 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:49 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:49 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:49 devstack sudo[76672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:49 devstack sudo[76672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:49 devstack sudo[76672]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:49 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:49 devstack cinder-volume[76398]: DEBUG cinder.brick.local_dev.lvm [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76398) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 15 18:22:49 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:49 devstack sudo[76752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:49 devstack sudo[76752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:50 devstack sudo[76752]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:50 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.567s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:50 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:50 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:50 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:50 devstack sudo[76926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:50 devstack sudo[76926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:50 devstack sudo[76926]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:50 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.342s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:50 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:50 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:50 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:50 devstack sudo[77008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 15 18:22:50 devstack sudo[77008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:50 devstack sudo[77008]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:50 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.300s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:50 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:50 devstack sudo[77068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:50 devstack sudo[77068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:51 devstack sudo[77068]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:51 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:51 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:51 devstack sudo[77094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:51 devstack sudo[77094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:51 devstack sudo[77094]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:51 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:51 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:51 devstack sudo[77113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:51 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:51 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:51 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:51 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:51 devstack sudo[77186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:51 devstack sudo[77186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:52 devstack sudo[77186]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:52 devstack sudo[77191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:52 devstack sudo[77191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:52 devstack sudo[77191]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:52 devstack cinder-volume[76398]: INFO cinder.volume.drivers.lvm [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:52 devstack sudo[77195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:52 devstack sudo[77195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:52 devstack sudo[77195]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG cinder.volume.drivers.lvm [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Updating volume stats {{(pid=76398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:52 devstack sudo[77198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:52 devstack sudo[77198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:52 devstack sudo[77198]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:52 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:53 devstack sudo[77201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:53 devstack sudo[77201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:53 devstack sudo[77201]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:53 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:53 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:53 devstack sudo[77204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:53 devstack sudo[77204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:53 devstack sudo[77204]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:53 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:53 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:53 devstack sudo[77208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:53 devstack sudo[77208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:53 devstack sudo[77208]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:53 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:53 devstack cinder-volume[76398]: INFO cinder.volume.driver [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Driver hasn't implemented _init_vendor_properties() Jul 15 18:22:53 devstack cinder-volume[76398]: DEBUG cinder.volume.driver [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76398) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 15 18:22:53 devstack cinder-volume[76398]: DEBUG oslo_db.sqlalchemy.engines [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:22:53 devstack cinder-volume[76398]: DEBUG dbcounter [-] [76398] Writer thread running {{(pid=76398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:22:53 devstack cinder-volume[76398]: DEBUG cinder.db.api [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Building query based on filter {{(pid=76398) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 15 18:22:54 devstack cinder-volume[76398]: DEBUG cinder.image.image_utils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76398) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 15 18:22:54 devstack cinder-volume[76398]: INFO cinder.keymgr.migration [None req-eb7f90ad-3dff-46eb-a48d-b58c9738a982 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 15 18:22:54 devstack cinder-volume[76398]: DEBUG cinder.volume.drivers.lvm [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Updating volume stats {{(pid=76398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:22:54 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:54 devstack sudo[77213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:54 devstack sudo[77213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:54 devstack sudo[77213]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:54 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:54 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:54 devstack sudo[77222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:54 devstack sudo[77222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:54 devstack sudo[77222]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:54 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:54 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:54 devstack sudo[77226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:54 devstack sudo[77226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:54 devstack sudo[77226]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:54 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:54 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:55 devstack sudo[77231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:55 devstack sudo[77231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:55 devstack sudo[77231]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:55 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:55 devstack cinder-volume[76398]: DEBUG cinder.manager [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Notifying Schedulers of capabilities ... {{(pid=76398) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:22:55 devstack cinder-volume[76398]: INFO cinder.volume.manager [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Driver initialization completed successfully. Jul 15 18:22:55 devstack cinder-volume[76398]: INFO cinder.manager [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Initiating service 2 cleanup Jul 15 18:22:55 devstack cinder-volume[76398]: INFO cinder.manager [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Service 2 cleanup completed. Jul 15 18:22:55 devstack cinder-volume[76398]: DEBUG cinder.service [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Creating RPC server for service cinder-volume {{(pid=76398) start /opt/stack/cinder/cinder/service.py:231}} Jul 15 18:22:55 devstack cinder-volume[76398]: DEBUG cinder.service [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76398) start /opt/stack/cinder/cinder/service.py:237}} Jul 15 18:22:55 devstack cinder-volume[76398]: INFO cinder.volume.manager [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 15 18:22:55 devstack cinder-volume[76398]: DEBUG cinder.volume.drivers.lvm [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Updating volume stats {{(pid=76398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:22:55 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:55 devstack sudo[77235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:55 devstack sudo[77235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:55 devstack sudo[77235]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:55 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:55 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:55 devstack sudo[77238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:55 devstack sudo[77238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:56 devstack sudo[77238]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:56 devstack sudo[77241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:56 devstack sudo[77241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:56 devstack sudo[77241]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:56 devstack sudo[77246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:56 devstack sudo[77246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:56 devstack sudo[77246]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:56 devstack cinder-volume[76398]: INFO cinder.volume.manager [None req-1e7f6826-57f5-4405-b9e6-592e544c776d None None] Driver post RPC initialization completed successfully. Jul 15 18:22:58 devstack cinder-volume[76261]: DEBUG dbcounter [-] [76261] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:23:06 devstack cinder-volume[76398]: DEBUG dbcounter [-] [76398] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:23:06 devstack cinder-volume[76398]: DEBUG dbcounter [-] [76398] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:23:56 devstack cinder-volume[76398]: DEBUG oslo_service.periodic_task [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76398) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:23:56 devstack cinder-volume[76398]: DEBUG cinder.volume.drivers.lvm [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Updating volume stats {{(pid=76398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:23:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:23:56 devstack sudo[79181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:23:56 devstack sudo[79181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:23:56 devstack sudo[79181]: pam_unix(sudo:session): session closed for user root Jul 15 18:23:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:23:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:23:56 devstack sudo[79184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:23:56 devstack sudo[79184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:23:57 devstack sudo[79184]: pam_unix(sudo:session): session closed for user root Jul 15 18:23:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:23:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:23:57 devstack sudo[79187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:23:57 devstack sudo[79187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:23:57 devstack sudo[79187]: pam_unix(sudo:session): session closed for user root Jul 15 18:23:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:23:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:23:57 devstack sudo[79190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:23:57 devstack sudo[79190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:23:57 devstack sudo[79190]: pam_unix(sudo:session): session closed for user root Jul 15 18:23:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:23:57 devstack cinder-volume[76398]: DEBUG cinder.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Notifying Schedulers of capabilities ... {{(pid=76398) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:23:57 devstack cinder-volume[76398]: DEBUG oslo_service.periodic_task [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=76398) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:23:57 devstack cinder-volume[76398]: DEBUG cinder.volume.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] thread count: 6 {{(pid=76398) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:23:57 devstack cinder-volume[76398]: DEBUG cinder.volume.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] thread info: [<_MainThread(MainThread, started 127418259722368)>, , , , , ] {{(pid=76398) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:24:56 devstack cinder-volume[76398]: DEBUG oslo_service.periodic_task [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76398) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:24:56 devstack cinder-volume[76398]: DEBUG cinder.volume.drivers.lvm [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Updating volume stats {{(pid=76398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:24:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:24:56 devstack sudo[82489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:24:56 devstack sudo[82489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:24:56 devstack sudo[82489]: pam_unix(sudo:session): session closed for user root Jul 15 18:24:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:24:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:24:57 devstack sudo[82492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:24:57 devstack sudo[82492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:24:57 devstack sudo[82492]: pam_unix(sudo:session): session closed for user root Jul 15 18:24:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:24:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:24:57 devstack sudo[82495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:24:57 devstack sudo[82495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:24:57 devstack sudo[82495]: pam_unix(sudo:session): session closed for user root Jul 15 18:24:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:24:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:24:57 devstack sudo[82498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:24:57 devstack sudo[82498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:24:57 devstack sudo[82498]: pam_unix(sudo:session): session closed for user root Jul 15 18:24:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:24:57 devstack cinder-volume[76398]: DEBUG cinder.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Notifying Schedulers of capabilities ... {{(pid=76398) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:24:57 devstack cinder-volume[76398]: DEBUG oslo_service.periodic_task [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=76398) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:24:57 devstack cinder-volume[76398]: DEBUG cinder.volume.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] thread count: 6 {{(pid=76398) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:24:57 devstack cinder-volume[76398]: DEBUG cinder.volume.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] thread info: [<_MainThread(MainThread, started 127418259722368)>, , , , , ] {{(pid=76398) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:25:06 devstack cinder-volume[76398]: DEBUG dbcounter [-] [76398] Writing DB stats cinder:SELECT=1 {{(pid=76398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:25:06 devstack cinder-volume[76398]: DEBUG dbcounter [-] [76398] Writing DB stats cinder:UPDATE=1 {{(pid=76398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:25:56 devstack cinder-volume[76398]: DEBUG oslo_service.periodic_task [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76398) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:25:56 devstack cinder-volume[76398]: DEBUG cinder.volume.drivers.lvm [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Updating volume stats {{(pid=76398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:25:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:25:56 devstack sudo[84599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:25:56 devstack sudo[84599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:25:56 devstack sudo[84599]: pam_unix(sudo:session): session closed for user root Jul 15 18:25:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:25:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:25:57 devstack sudo[84604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:25:57 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:25:57 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root Jul 15 18:25:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:25:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:25:57 devstack sudo[84618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:25:57 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:25:57 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root Jul 15 18:25:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:25:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:25:57 devstack sudo[84621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:25:57 devstack sudo[84621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:25:57 devstack sudo[84621]: pam_unix(sudo:session): session closed for user root Jul 15 18:25:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:25:57 devstack cinder-volume[76398]: DEBUG cinder.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Notifying Schedulers of capabilities ... {{(pid=76398) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:26:56 devstack cinder-volume[76398]: DEBUG oslo_service.periodic_task [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76398) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:26:56 devstack cinder-volume[76398]: DEBUG cinder.volume.drivers.lvm [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Updating volume stats {{(pid=76398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:26:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:26:56 devstack sudo[85614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:26:56 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:26:56 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root Jul 15 18:26:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:26:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:26:56 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:26:56 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:26:57 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Jul 15 18:26:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:26:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:26:57 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:26:57 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:26:57 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Jul 15 18:26:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:26:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:26:57 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:26:57 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:26:57 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Jul 15 18:26:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:26:57 devstack cinder-volume[76398]: DEBUG cinder.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Notifying Schedulers of capabilities ... {{(pid=76398) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:26:57 devstack cinder-volume[76398]: DEBUG oslo_service.periodic_task [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=76398) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:26:57 devstack cinder-volume[76398]: DEBUG cinder.volume.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] thread count: 6 {{(pid=76398) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:26:57 devstack cinder-volume[76398]: DEBUG cinder.volume.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] thread info: [<_MainThread(MainThread, started 127418259722368)>, , , , , ] {{(pid=76398) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:27:06 devstack cinder-volume[76398]: DEBUG dbcounter [-] [76398] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:27:56 devstack cinder-volume[76398]: DEBUG oslo_service.periodic_task [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76398) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:27:56 devstack cinder-volume[76398]: DEBUG cinder.volume.drivers.lvm [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Updating volume stats {{(pid=76398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:27:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:56 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:27:56 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:56 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:56 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:57 devstack sudo[86529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:27:57 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:57 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:57 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:27:57 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:57 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:57 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:27:57 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:57 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:57 devstack cinder-volume[76398]: DEBUG oslo_concurrency.processutils [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:57 devstack cinder-volume[76398]: DEBUG cinder.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Notifying Schedulers of capabilities ... {{(pid=76398) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:27:57 devstack cinder-volume[76398]: DEBUG oslo_service.periodic_task [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] Running periodic task VolumeManager._thread_info {{(pid=76398) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:27:57 devstack cinder-volume[76398]: DEBUG cinder.volume.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] thread count: 6 {{(pid=76398) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:27:57 devstack cinder-volume[76398]: DEBUG cinder.volume.manager [None req-df9d0a70-5afd-4b4f-9823-a9d85316d6aa None None] thread info: [<_MainThread(MainThread, started 127418259722368)>, , , , , ] {{(pid=76398) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:28:12 devstack cinder-volume[76261]: INFO oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Caught SIGTERM, stopping children Jul 15 18:28:12 devstack cinder-volume[76261]: DEBUG oslo_concurrency.lockutils [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Acquiring lock "singleton_lock" {{(pid=76261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:28:12 devstack cinder-volume[76261]: DEBUG oslo_concurrency.lockutils [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Acquired lock "singleton_lock" {{(pid=76261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:28:12 devstack cinder-volume[76261]: DEBUG oslo_concurrency.lockutils [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Releasing lock "singleton_lock" {{(pid=76261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:28:12 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Stop services. {{(pid=76261) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 15 18:28:12 devstack cinder-volume[76261]: DEBUG oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Killing children. {{(pid=76261) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 15 18:28:12 devstack cinder-volume[76261]: INFO oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Waiting on 1 children to exit Jul 15 18:28:15 devstack cinder-volume[76398]: DEBUG oslo_concurrency.lockutils [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Acquiring lock "singleton_lock" {{(pid=76398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:28:15 devstack cinder-volume[76398]: DEBUG oslo_concurrency.lockutils [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Acquired lock "singleton_lock" {{(pid=76398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:28:15 devstack cinder-volume[76398]: DEBUG oslo_concurrency.lockutils [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Releasing lock "singleton_lock" {{(pid=76398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:28:15 devstack cinder-volume[76398]: WARNING amqp [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 15 18:28:15 devstack cinder-volume[76398]: WARNING amqp [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 15 18:28:15 devstack cinder-volume[76261]: INFO oslo_service.backend._eventlet.service [None req-0d791854-a8bd-4841-863b-2683e1ce778f None None] Child 76398 exited with status 0 Jul 15 18:28:15 devstack cinder-volume[86970]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 15 18:28:15 devstack cinder-volume[86970]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 15 18:28:15 devstack cinder-volume[86970]: we strongly recommend against using it for new projects. Jul 15 18:28:15 devstack cinder-volume[86970]: If you are already using Eventlet, we recommend migrating to a different Jul 15 18:28:15 devstack cinder-volume[86970]: framework. For more detail see Jul 15 18:28:15 devstack cinder-volume[86970]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 15 18:28:15 devstack cinder-volume[86970]: import eventlet # noqa Jul 15 18:28:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:28:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:28:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:28:18 devstack cinder-volume[86970]: INFO dbcounter [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Registered counter for database cinder Jul 15 18:28:18 devstack cinder-volume[86970]: DEBUG oslo_db.sqlalchemy.engines [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writer thread running {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:28:19 devstack cinder-volume[86970]: INFO cinder.rpc [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 15 18:28:19 devstack cinder-volume[86970]: INFO cinder.rpc [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_db.sqlalchemy.engines [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:28:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Determined volume DB was empty at startup. Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86970) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 15 18:28:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 15 18:28:19 devstack cinder-volume[86970]: WARNING stevedore.named [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 15 18:28:19 devstack cinder-volume[86970]: WARNING castellan.key_manager [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:28:19 devstack cinder-volume[86970]: WARNING cinder.keymgr.conf_key_mgr [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:28:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_db.sqlalchemy.engines [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:28:19 devstack cinder-volume[86970]: INFO oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Starting 1 workers Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Started child 87188 {{(pid=86970) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Full set of CONF: {{(pid=86970) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] ******************************************************************************** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Configuration options gathered from: {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] ================================================================================ {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] allow_availability_zone_fallback = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] allow_compression_on_image_upload = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] allowed_direct_url_schemes = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] api_rate_limit = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] auth_strategy = keystone {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[87188]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_availability_zone = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_host = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_stats_polling_interval = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backup_api_class = cinder.backup.api.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backup_name_template = backup-%s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backup_use_same_host = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backup_use_temp_snapshot = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] chap_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] chap_username = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cinder_internal_tenant_project_id = e1e98578ce004fa9b31081456af4ccac {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cinder_internal_tenant_user_id = 74625daa26964600b64694aac37868a1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cluster = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] compression_format = gzip {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] compute_api_class = cinder.compute.nova.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] config_dir = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] config_source = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] control_exchange = openstack {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] debug = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] default_availability_zone = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] default_group_type = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] default_volume_type = QuobyteHD {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] disk_geometry = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] driver_client_cert = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] driver_client_cert_key = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] driver_data_namespace = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] driver_ssl_cert_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] driver_ssl_cert_verify = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] driver_use_ssl = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] enable_new_services = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] enable_unsupported_driver = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] enabled_backends = ['QuobyteHD'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] enforce_multipath_for_image_xfer = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] filter_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance_api_insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance_api_servers = ['http://192.168.122.35/image'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance_api_ssl_compression = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance_ca_certificates_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance_catalog_info = image:glance:publicURL {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance_certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance_keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance_num_retries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance_request_timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] goodness_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] graceful_shutdown_timeout = 5 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] group_api_class = cinder.group.api.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] host = devstack {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] image_compress_on_upload = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] image_conversion_address_space_limit = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] image_conversion_cpu_limit = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] image_conversion_disable = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] image_upload_use_cinder_backend = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] image_upload_use_internal_tenant = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] image_volume_cache_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] image_volume_cache_max_count = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] image_volume_cache_max_size_gb = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] init_host_max_objects_retrieval = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] instance_format = [instance: %(uuid)s] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] iscsi_target_flags = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] iscsi_write_cache = on {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] iser_helper = tgtadm {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] iser_ip_address = 192.168.122.35 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[87188]: INFO cinder.volume.manager [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Starting volume driver QuobyteDriver (1.1.14) Jul 15 18:28:19 devstack cinder-volume[87188]: DEBUG cinder.volume.drivers.remotefs [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87188) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] iser_port = 3260 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] log_color = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] log_config_append = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] log_dir = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] log_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] log_options = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] log_rotate_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] log_rotate_interval_type = days {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] log_rotation_type = none {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] max_age = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] max_logfile_count = 30 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] max_logfile_size_mb = 200 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] max_over_subscription_ratio = 20.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] message_reap_interval = 86400 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] message_ttl = 2592000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] migration_create_volume_timeout_secs = 300 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] monkey_patch = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] monkey_patch_modules = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] my_ip = 192.168.122.35 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] no_snapshot_gb_quota = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] num_iser_scan_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] num_shell_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] num_volume_device_scan_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] nvmeof_conn_info_version = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] nvmet_ns_id = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] nvmet_port_id = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] osapi_max_limit = 1000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] osapi_volume_ext_list = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] osapi_volume_listen_port = 8776 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] osapi_volume_use_ssl = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] osapi_volume_workers = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] per_volume_size_limit = -1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] periodic_fuzzy_delay = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] periodic_interval = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] public_endpoint = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] publish_errors = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] quota_backup_gigabytes = 1000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] quota_backups = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] quota_gigabytes = 1000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] quota_groups = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] quota_snapshots = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] quota_volumes = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] rate_limit_burst = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] rate_limit_except_level = CRITICAL {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] rate_limit_interval = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] reinit_driver_count = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] replication_device = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] report_discard_supported = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] report_interval = 120 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] reservation_clean_interval = 86400 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] reservation_expire = 86400 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] reserved_image_namespaces = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] reserved_percentage = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] rpc_response_timeout = 120 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] run_external_periodic_tasks = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] scst_target_driver = iscsi {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] scst_target_iqn_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_down_time = 720 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] shell_completion = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] snapshot_name_template = snapshot-%s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] split_loggers = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] state_path = /opt/stack/data/cinder {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] storage_availability_zone = nova {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] storage_protocol = iSCSI {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] syslog_log_facility = LOG_USER {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] target_helper = lioadm {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] target_ip_address = 192.168.122.35 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] target_port = 3260 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] target_protocol = iscsi {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] target_secondary_ip_addresses = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] trace_flags = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] transport_url = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] until_refresh = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] use_chap_auth = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] use_default_quota_class = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] use_journal = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] use_json = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] use_multipath_for_image_xfer = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] use_stderr = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] use_syslog = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] verify_glance_signatures = enabled {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_api_class = cinder.volume.api.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_backend_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_clear = zero {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_clear_ionice = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_clear_size = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_copy_bps_limit = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_dd_blocksize = 1M {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_name_template = volume-%s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_service_inithost_offload = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volume_usage_audit_period = month {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] zoning_mode = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_concurrency.disable_process_locking = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.auth_section = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.auth_type = password {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.auth_version = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.cache = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.include_service_catalog = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.interface = public {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_password = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcache_username = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.region_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[87188]: DEBUG cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87188) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 15 18:28:19 devstack cinder-volume[87188]: WARNING cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 15 18:28:19 devstack cinder-volume[87188]: WARNING cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.service_type = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Running cmd (subprocess): mount.quobyte {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.35/identity {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.backend = dogpile.cache.null {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.backend_argument = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.backend_expiration_time = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.config_prefix = cache.oslo {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.debug_cache_backend = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.enable_retry_client = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.enable_socket_keepalive = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.expiration_time = 600 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.hashclient_retry_attempts = 2 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.memcache_dead_retry = 300 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.memcache_pool_maxsize = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.memcache_sasl_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.proxies = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.redis_db = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.redis_server = localhost:6379 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.retry_attempts = 2 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.retry_delay = 0.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.socket_keepalive_count = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.socket_keepalive_idle = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.socket_keepalive_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.socket_timeout = 1.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.tls_allowed_ciphers = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.tls_cafile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.tls_certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.tls_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.tls_keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cache.username = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] coordination.backend_url = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.asyncio_connection = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.asyncio_slave_connection = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.backend = sqlalchemy {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.connection = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.connection_debug = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.connection_parameters = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.connection_recycle_time = 3600 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.connection_trace = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.db_inc_retry_interval = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.db_max_retries = 20 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.db_max_retry_interval = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.db_retry_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.max_overflow = 50 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.max_pool_size = 5 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.max_retries = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.mysql_wsrep_sync_wait = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.pool_timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.retry_interval = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.slave_connection = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.sqlite_synchronous = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.synchronous_reader = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] database.use_db_reconnect = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.connection_string = messaging:// {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.es_doc_type = notification {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.es_scroll_size = 10000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.es_scroll_time = 2m {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.filter_error_trace = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.hmac_keys = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.sentinel_service_name = mymaster {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.socket_timeout = 0.1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.trace_requests = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler.trace_sqlalchemy = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler_jaeger.process_tags = {} {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler_jaeger.service_name_prefix = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] profiler_otlp.service_name_prefix = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.enforce_new_defaults = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.enforce_scope = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.policy_default_rule = default {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.policy_file = policy.yaml {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] privsep_osbrick.group = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] privsep_osbrick.helper_command = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] privsep_osbrick.user = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cinder_sys_admin.group = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cinder_sys_admin.helper_command = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] cinder_sys_admin.user = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_user.auth_section = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_user.auth_type = password {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_user.cafile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_user.certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_user.collect_timing = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_user.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_user.keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_user.send_service_user_token = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_user.split_loggers = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] service_user.timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance.auth_section = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance.auth_type = password {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance.certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance.collect_timing = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack quobyte-client[87191]: Reading configuration file: /etc/quobyte/client.cfg Jul 15 18:28:19 devstack quobyte-client[87191]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance.keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance.region_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance.split_loggers = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:19 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:28:19 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:28:19 devstack cinder-volume[87188]: DEBUG cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] glance.timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.backend_availability_zone = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.chap_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.chap_username = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[87188]: INFO cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c ... Jul 15 18:28:19 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 -c /etc/quobyte/client-cinder.cfg {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.disk_geometry = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.driver_client_cert = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.driver_client_cert_key = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.driver_data_namespace = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.driver_use_ssl = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.extra_capabilities = {} {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.filter_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.goodness_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.iscsi_target_flags = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.iscsi_write_cache = on {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.iser_helper = tgtadm {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.iser_ip_address = 192.168.122.35 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.iser_port = 3260 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nas_host = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nas_login = admin {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nas_mount_options = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nas_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nas_private_key = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nas_share_path = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.num_shell_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 -c /etc/quobyte/client-cinder.cfg Jul 15 18:28:19 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.quobyte_volume_url = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.replication_device = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.report_discard_supported = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.reserved_percentage = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.target_helper = tgtadm {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.target_ip_address = 192.168.122.35 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.target_port = 3260 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.target_protocol = iscsi {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.trace_flags = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.unique_fqdn_network = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.use_chap_auth = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.volume_backend_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.volume_clear = zero {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.volume_clear_ionice = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.volume_clear_size = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_reports.file_event_handler = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_reports.log_dir = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.backend_availability_zone = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.backend_host = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.chap_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.chap_username = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.chiscsi_conf = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.disk_geometry = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.driver_client_cert = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.driver_data_namespace = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.driver_use_ssl = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.extra_capabilities = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.filter_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.goodness_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.iser_helper = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.iser_ip_address = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.iser_port = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.iser_target_prefix = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nas_host = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nas_login = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nas_mount_options = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nas_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nas_private_key = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nas_share_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nas_ssh_port = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.num_shell_tries = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.nvmet_port_id = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.replication_device = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.report_discard_supported = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.reserved_percentage = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.scst_target_driver = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.storage_protocol = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.target_helper = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.target_ip_address = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.target_port = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.target_prefix = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.target_protocol = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.trace_flags = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.use_chap_auth = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.volume_clear = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.volume_clear_size = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] QuobyteHD.volumes_dir = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.ssl = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_notifications.driver = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_notifications.retry = -1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] key_manager.fixed_key = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.barbican_api_version = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.barbican_endpoint = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.barbican_endpoint_type = public {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.barbican_region_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.cafile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.collect_timing = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.number_of_retries = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.retry_delay = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.send_service_user_token = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.split_loggers = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.verify_ssl = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican.verify_ssl_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican_service_user.auth_section = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican_service_user.auth_type = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican_service_user.cafile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican_service_user.certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican_service_user.collect_timing = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican_service_user.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican_service_user.keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican_service_user.split_loggers = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] barbican_service_user.timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.approle_role_id = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.approle_secret_id = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.auth_method = approle {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.auth_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.kv_mountpoint = secret {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.kv_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.kv_version = 2 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.namespace = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.root_token_id = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.ssl_ca_crt_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.timeout = 60.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.token_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.token_role = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.use_ssl = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:19 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] ******************************************************************************** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 15 18:28:20 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.380s {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:20 devstack cinder-volume[87188]: INFO cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c succeeded Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.393s {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:20 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:28:20 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:28:20 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.251s {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:20 devstack cinder-volume[87188]: INFO cinder.volume.driver [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Driver hasn't implemented _init_vendor_properties() Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.volume.driver [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5915908813477, 'free_capacity_gb': 1775.5915908813477, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87188) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_db.sqlalchemy.engines [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG dbcounter [-] [87188] Writer thread running {{(pid=87188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.db.api [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Building query based on filter {{(pid=87188) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.image.image_utils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87188) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 15 18:28:20 devstack cinder-volume[87188]: INFO cinder.keymgr.migration [None req-9dd902c3-5954-4252-911f-059613b6912a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:20 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:28:20 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:28:20 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.243s {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.manager [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Notifying Schedulers of capabilities ... {{(pid=87188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:28:20 devstack cinder-volume[87188]: INFO cinder.volume.manager [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Driver initialization completed successfully. Jul 15 18:28:20 devstack cinder-volume[87188]: INFO cinder.manager [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Initiating service 3 cleanup Jul 15 18:28:20 devstack cinder-volume[87188]: INFO cinder.manager [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Service 3 cleanup completed. Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.service [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Creating RPC server for service cinder-volume {{(pid=87188) start /opt/stack/cinder/cinder/service.py:231}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.service [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87188) start /opt/stack/cinder/cinder/service.py:237}} Jul 15 18:28:20 devstack cinder-volume[87188]: INFO cinder.volume.manager [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG cinder.volume.drivers.quobyte [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:28:20 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:20 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:28:20 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:28:21 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Jul 15 18:28:21 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.260s {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:21 devstack cinder-volume[87188]: INFO cinder.volume.manager [None req-2f508c14-79ba-4055-b928-d18c2262a4ed None None] Driver post RPC initialization completed successfully. Jul 15 18:28:25 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-b80c68c1-b8cc-4d13-a38f-24a038d2bfd8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:28:25 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-b80c68c1-b8cc-4d13-a38f-24a038d2bfd8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:28:25 devstack cinder-volume[87188]: DEBUG cinder.volume.drivers.quobyte [None req-b80c68c1-b8cc-4d13-a38f-24a038d2bfd8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:28:25 devstack cinder-volume[87188]: DEBUG cinder.volume.drivers.quobyte [None req-b80c68c1-b8cc-4d13-a38f-24a038d2bfd8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:28:25 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-b80c68c1-b8cc-4d13-a38f-24a038d2bfd8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:28:25 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-b80c68c1-b8cc-4d13-a38f-24a038d2bfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:25 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:28:25 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:28:25 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Jul 15 18:28:25 devstack cinder-volume[87188]: DEBUG oslo_concurrency.processutils [None req-b80c68c1-b8cc-4d13-a38f-24a038d2bfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.226s {{(pid=87188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:25 devstack cinder-volume[87188]: DEBUG cinder.manager [None req-b80c68c1-b8cc-4d13-a38f-24a038d2bfd8 None None] Notifying Schedulers of capabilities ... {{(pid=87188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:28:28 devstack cinder-volume[86970]: INFO oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Caught SIGTERM, stopping children Jul 15 18:28:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Acquiring lock "singleton_lock" {{(pid=86970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:28:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Acquired lock "singleton_lock" {{(pid=86970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:28:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Releasing lock "singleton_lock" {{(pid=86970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:28:28 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Stop services. {{(pid=86970) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 15 18:28:28 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Killing children. {{(pid=86970) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 15 18:28:28 devstack cinder-volume[86970]: INFO oslo_service.backend._eventlet.service [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Waiting on 1 children to exit Jul 15 18:28:31 devstack cinder-volume[87188]: DEBUG dbcounter [-] [87188] Writing DB stats cinder:SELECT=4 {{(pid=87188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:28:31 devstack cinder-volume[87188]: DEBUG dbcounter [-] [87188] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:28:33 devstack cinder-volume[87188]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 15 18:28:33 devstack cinder-volume[87551]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 15 18:28:33 devstack cinder-volume[87551]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 15 18:28:33 devstack cinder-volume[87551]: we strongly recommend against using it for new projects. Jul 15 18:28:33 devstack cinder-volume[87551]: If you are already using Eventlet, we recommend migrating to a different Jul 15 18:28:33 devstack cinder-volume[87551]: framework. For more detail see Jul 15 18:28:33 devstack cinder-volume[87551]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 15 18:28:33 devstack cinder-volume[87551]: import eventlet # noqa Jul 15 18:28:34 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Acquiring lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:28:34 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Acquired lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:28:34 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Releasing lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:28:34 devstack cinder-volume[87188]: WARNING amqp [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 15 18:28:34 devstack cinder-volume[87188]: WARNING amqp [None req-4444351d-6819-4c9f-b451-86784a1d2304 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 15 18:28:36 devstack cinder-volume[87551]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:28:36 devstack cinder-volume[87551]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:28:36 devstack cinder-volume[87551]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:28:37 devstack cinder-volume[87551]: INFO dbcounter [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Registered counter for database cinder Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_db.sqlalchemy.engines [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG dbcounter [-] [87551] Writer thread running {{(pid=87551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:28:37 devstack cinder-volume[87551]: INFO cinder.rpc [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 15 18:28:37 devstack cinder-volume[87551]: INFO cinder.rpc [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_db.sqlalchemy.engines [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:28:37 devstack cinder-volume[87551]: INFO cinder.volume.manager [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Determined volume DB was empty at startup. Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG cinder.volume.manager [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87551) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 15 18:28:37 devstack cinder-volume[87551]: WARNING stevedore.named [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 15 18:28:37 devstack cinder-volume[87551]: WARNING castellan.key_manager [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:28:37 devstack cinder-volume[87551]: WARNING cinder.keymgr.conf_key_mgr [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:28:37 devstack cinder-volume[87551]: INFO cinder.volume.manager [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_db.sqlalchemy.engines [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:28:37 devstack cinder-volume[87551]: INFO oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Starting 1 workers Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Started child 87863 {{(pid=87551) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Full set of CONF: {{(pid=87551) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] ******************************************************************************** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] Configuration options gathered from: {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 15 18:28:37 devstack cinder-volume[87863]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] ================================================================================ {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] allow_availability_zone_fallback = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] allow_compression_on_image_upload = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] allowed_direct_url_schemes = [] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] api_rate_limit = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] auth_strategy = keystone {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_availability_zone = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_host = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_name = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_stats_polling_interval = 60 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backup_api_class = cinder.backup.api.API {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backup_name_template = backup-%s {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backup_use_same_host = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backup_use_temp_snapshot = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] chap_password = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] chap_username = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cinder_internal_tenant_project_id = e1e98578ce004fa9b31081456af4ccac {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cinder_internal_tenant_user_id = 74625daa26964600b64694aac37868a1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cluster = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] compression_format = gzip {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] compute_api_class = cinder.compute.nova.API {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] config_dir = [] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] config_source = [] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] control_exchange = openstack {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] debug = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] default_availability_zone = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] default_group_type = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] default_volume_type = QuobyteHD {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] disk_geometry = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] driver_client_cert = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] driver_client_cert_key = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] driver_data_namespace = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] driver_ssl_cert_path = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] driver_ssl_cert_verify = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] driver_use_ssl = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] enable_new_services = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] enable_unsupported_driver = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] enabled_backends = ['QuobyteHD'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] enforce_multipath_for_image_xfer = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] filter_function = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance_api_insecure = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance_api_servers = ['http://192.168.122.35/image'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance_api_ssl_compression = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance_ca_certificates_file = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance_catalog_info = image:glance:publicURL {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance_certfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance_keyfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance_num_retries = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance_request_timeout = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] goodness_function = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] graceful_shutdown_timeout = 5 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] group_api_class = cinder.group.api.API {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] host = devstack {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] image_compress_on_upload = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] image_conversion_address_space_limit = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] image_conversion_cpu_limit = 60 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] image_conversion_disable = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] image_upload_use_cinder_backend = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] image_upload_use_internal_tenant = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] image_volume_cache_enabled = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] image_volume_cache_max_count = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] image_volume_cache_max_size_gb = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] init_host_max_objects_retrieval = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] instance_format = [instance: %(uuid)s] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] iscsi_target_flags = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] iscsi_write_cache = on {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] iser_helper = tgtadm {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] iser_ip_address = 192.168.122.35 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] iser_port = 3260 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] log_color = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] log_config_append = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] log_dir = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] log_file = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] log_options = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] log_rotate_interval = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] log_rotate_interval_type = days {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] log_rotation_type = none {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 15 18:28:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87863) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] max_age = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] max_logfile_count = 30 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] max_logfile_size_mb = 200 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] max_over_subscription_ratio = 20.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] message_reap_interval = 86400 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] message_ttl = 2592000 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] migration_create_volume_timeout_secs = 300 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] monkey_patch = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] monkey_patch_modules = [] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] my_ip = 192.168.122.35 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] no_snapshot_gb_quota = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] num_iser_scan_tries = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] num_shell_tries = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] num_volume_device_scan_tries = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] nvmeof_conn_info_version = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] nvmet_ns_id = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] nvmet_port_id = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] osapi_max_limit = 1000 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] osapi_volume_ext_list = [] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] osapi_volume_listen_port = 8776 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] osapi_volume_use_ssl = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] osapi_volume_workers = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] per_volume_size_limit = -1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] periodic_fuzzy_delay = 60 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] periodic_interval = 60 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] public_endpoint = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] publish_errors = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] quota_backup_gigabytes = 1000 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] quota_backups = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] quota_gigabytes = 1000 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] quota_groups = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] quota_snapshots = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] quota_volumes = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] rate_limit_burst = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] rate_limit_except_level = CRITICAL {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] rate_limit_interval = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] reinit_driver_count = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] replication_device = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] report_discard_supported = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] report_interval = 120 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] reservation_clean_interval = 86400 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] reservation_expire = 86400 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] reserved_image_namespaces = [] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] reserved_percentage = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] rpc_response_timeout = 120 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] run_external_periodic_tasks = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] scst_target_driver = iscsi {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] scst_target_iqn_name = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_down_time = 720 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] shell_completion = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] snapshot_name_template = snapshot-%s {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] split_loggers = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] state_path = /opt/stack/data/cinder {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] storage_availability_zone = nova {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] storage_protocol = iSCSI {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] syslog_log_facility = LOG_USER {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] target_helper = lioadm {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] target_ip_address = 192.168.122.35 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] target_port = 3260 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] target_protocol = iscsi {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] target_secondary_ip_addresses = [] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] trace_flags = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] transport_url = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] until_refresh = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] use_chap_auth = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] use_default_quota_class = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] use_journal = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] use_json = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] use_multipath_for_image_xfer = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] use_stderr = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] use_syslog = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] verify_glance_signatures = enabled {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_api_class = cinder.volume.api.API {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_backend_name = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_clear = zero {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_clear_ionice = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_clear_size = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_copy_bps_limit = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_dd_blocksize = 1M {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_name_template = volume-%s {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_service_inithost_offload = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volume_usage_audit_period = month {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] zoning_mode = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_concurrency.disable_process_locking = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.auth_section = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.auth_type = password {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.auth_version = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.cache = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.certfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.include_service_catalog = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.insecure = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.interface = public {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.keyfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_password = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcache_username = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.region_name = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.service_type = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.35/identity {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.backend = dogpile.cache.null {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.backend_argument = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.backend_expiration_time = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.config_prefix = cache.oslo {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.debug_cache_backend = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.enable_retry_client = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.enable_socket_keepalive = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.enabled = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.expiration_time = 600 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.hashclient_retry_attempts = 2 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.memcache_dead_retry = 300 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.memcache_pool_maxsize = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.memcache_sasl_enabled = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.password = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.proxies = [] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.redis_db = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.redis_server = localhost:6379 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.retry_attempts = 2 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.retry_delay = 0.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.socket_keepalive_count = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.socket_keepalive_idle = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.socket_keepalive_interval = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.socket_timeout = 1.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.tls_allowed_ciphers = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.tls_cafile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.tls_certfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.tls_enabled = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.tls_keyfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cache.username = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] coordination.backend_url = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.asyncio_connection = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.asyncio_slave_connection = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.backend = sqlalchemy {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.connection = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.connection_debug = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.connection_parameters = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.connection_recycle_time = 3600 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.connection_trace = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.db_inc_retry_interval = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.db_max_retries = 20 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.db_max_retry_interval = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.db_retry_interval = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.max_overflow = 50 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.max_pool_size = 5 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.max_retries = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.mysql_wsrep_sync_wait = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.pool_timeout = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.retry_interval = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.slave_connection = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.sqlite_synchronous = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.synchronous_reader = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] database.use_db_reconnect = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.connection_string = messaging:// {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.enabled = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.es_doc_type = notification {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.es_scroll_size = 10000 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.es_scroll_time = 2m {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.filter_error_trace = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.hmac_keys = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.sentinel_service_name = mymaster {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.socket_timeout = 0.1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.trace_requests = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler.trace_sqlalchemy = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler_jaeger.process_tags = {} {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler_jaeger.service_name_prefix = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] profiler_otlp.service_name_prefix = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.enforce_new_defaults = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.enforce_scope = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.policy_default_rule = default {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.policy_file = policy.yaml {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] privsep_osbrick.group = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] privsep_osbrick.helper_command = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] privsep_osbrick.user = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cinder_sys_admin.group = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cinder_sys_admin.helper_command = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] cinder_sys_admin.user = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_user.auth_section = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_user.auth_type = password {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_user.cafile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_user.certfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_user.collect_timing = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_user.insecure = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_user.keyfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_user.send_service_user_token = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_user.split_loggers = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] service_user.timeout = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance.auth_section = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance.auth_type = password {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance.certfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance.collect_timing = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance.insecure = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance.keyfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance.region_name = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance.split_loggers = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] glance.timeout = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.backend_availability_zone = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.chap_password = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.chap_username = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.disk_geometry = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.driver_client_cert = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.driver_client_cert_key = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.driver_data_namespace = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.driver_use_ssl = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.extra_capabilities = {} {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.filter_function = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.goodness_function = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.iscsi_target_flags = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.iscsi_write_cache = on {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.iser_helper = tgtadm {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.iser_ip_address = 192.168.122.35 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.iser_port = 3260 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nas_host = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nas_login = admin {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nas_mount_options = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nas_password = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nas_private_key = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nas_share_path = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.num_shell_tries = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.quobyte_volume_url = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.replication_device = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.report_discard_supported = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.reserved_percentage = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.target_helper = tgtadm {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.target_ip_address = 192.168.122.35 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.target_port = 3260 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.target_protocol = iscsi {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87863) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 15 18:28:37 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.quobyte [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 15 18:28:37 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.quobyte [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.trace_flags = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.unique_fqdn_network = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.use_chap_auth = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Running cmd (subprocess): mount.quobyte {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.volume_backend_name = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.volume_clear = zero {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.volume_clear_ionice = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.volume_clear_size = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_reports.file_event_handler = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_reports.log_dir = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.backend_availability_zone = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.backend_host = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.chap_password = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.chap_username = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.chiscsi_conf = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.disk_geometry = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.driver_client_cert = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:37 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.driver_data_namespace = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.driver_use_ssl = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.extra_capabilities = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.filter_function = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.goodness_function = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.iser_helper = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.iser_ip_address = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.iser_port = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.iser_target_prefix = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nas_host = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nas_login = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nas_mount_options = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nas_password = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nas_private_key = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nas_share_path = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nas_ssh_port = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.num_shell_tries = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.nvmet_port_id = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.replication_device = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.report_discard_supported = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.reserved_percentage = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.scst_target_driver = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.storage_protocol = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.target_helper = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.target_ip_address = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.target_port = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.target_prefix = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.target_protocol = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.trace_flags = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.use_chap_auth = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.volume_clear = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.volume_clear_size = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] QuobyteHD.volumes_dir = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack quobyte-client[87864]: Reading configuration file: /etc/quobyte/client.cfg Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack quobyte-client[87864]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.ssl = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_notifications.driver = [] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_notifications.retry = -1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] key_manager.fixed_key = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.barbican_api_version = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.barbican_endpoint = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.barbican_endpoint_type = public {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.barbican_region_name = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.cafile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.certfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.collect_timing = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.insecure = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.keyfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.number_of_retries = 60 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.retry_delay = 1 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.send_service_user_token = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.split_loggers = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.timeout = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.verify_ssl = True {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican.verify_ssl_path = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican_service_user.auth_section = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican_service_user.auth_type = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican_service_user.cafile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican_service_user.certfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican_service_user.collect_timing = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican_service_user.insecure = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican_service_user.keyfile = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican_service_user.split_loggers = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] barbican_service_user.timeout = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.approle_role_id = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.approle_secret_id = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.auth_method = approle {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.auth_path = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.kv_mountpoint = secret {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.kv_path = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.kv_version = 2 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.namespace = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.root_token_id = **** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.ssl_ca_crt_file = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.timeout = 60.0 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.token_file = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.token_role = None {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.use_ssl = False {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:28:38 devstack cinder-volume[87551]: DEBUG oslo_service.backend._eventlet.service [None req-0e9fcdac-3880-4cce-912b-d8e0cb15ca59 None None] ******************************************************************************** {{(pid=87551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 15 18:28:38 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:28:38 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:28:38 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.254s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:38 devstack cinder-volume[87863]: INFO cinder.volume.driver [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Driver hasn't implemented _init_vendor_properties() Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.volume.driver [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6894493103027, 'free_capacity_gb': 1775.6894493103027, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87863) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_db.sqlalchemy.engines [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writer thread running {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.db.api [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Building query based on filter {{(pid=87863) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87863) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:38 devstack cinder-volume[87863]: INFO cinder.keymgr.migration [None req-6ff2a1c7-1614-4a51-89d1-c5ff062dfa4b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 15 18:28:38 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:28:38 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:28:38 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.245s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:28:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Driver initialization completed successfully. Jul 15 18:28:38 devstack cinder-volume[87863]: INFO cinder.manager [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Initiating service 3 cleanup Jul 15 18:28:38 devstack cinder-volume[87863]: INFO cinder.manager [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Service 3 cleanup completed. Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.service [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Creating RPC server for service cinder-volume {{(pid=87863) start /opt/stack/cinder/cinder/service.py:231}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.service [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87863) start /opt/stack/cinder/cinder/service.py:237}} Jul 15 18:28:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:28:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:38 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:28:38 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:28:39 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Jul 15 18:28:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.263s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:39 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5dab7f05-28b2-47d1-a19c-23065636cc53 None None] Driver post RPC initialization completed successfully. Jul 15 18:28:47 devstack cinder-volume[87551]: DEBUG dbcounter [-] [87551] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:28:48 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:28:49 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=2 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:29:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:29:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 6 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:29:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Flow 'volume_create_manager' (7892c565-901e-4c57-a6da-acc684952f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a01e71-7926-4f5e-b087-7655f6e004c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a01e71-7926-4f5e-b087-7655f6e004c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-588778856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1266da26-362d-485a-a2f8-79f9cda396a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a559f53dcc834dfaad1c078de303b840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:29:37Z,use_quota=True,user_id='594dfcfd2f80480c8f568a923e783151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34709e5-a0f5-436e-9c7d-0a4b4a4e1da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34709e5-a0f5-436e-9c7d-0a4b4a4e1da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f2a0c7-36d2-4887-bce2-7d2fada0d36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f2a0c7-36d2-4887-bce2-7d2fada0d36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1266da26-362d-485a-a2f8-79f9cda396a9', 'volume_name': 'volume-1266da26-362d-485a-a2f8-79f9cda396a9', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c907fa-5f61-4ef8-b0a9-fe7bef76e799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c907fa-5f61-4ef8-b0a9-fe7bef76e799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aef9c3b-d6e7-476c-bf4f-b42a446502a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Volume 1266da26-362d-485a-a2f8-79f9cda396a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1266da26-362d-485a-a2f8-79f9cda396a9', 'volume_size': 1} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-588778856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1266da26-362d-485a-a2f8-79f9cda396a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a559f53dcc834dfaad1c078de303b840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:29:37Z,use_quota=True,user_id='594dfcfd2f80480c8f568a923e783151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Creating volume 1266da26-362d-485a-a2f8-79f9cda396a9 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:29:37 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:29:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:29:37 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 1073741824 Jul 15 18:29:37 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:29:38 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Jul 15 18:29:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 1073741824" returned: 0 in 0.930s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:29:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:29:38 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 Jul 15 18:29:38 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:29:38 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Jul 15 18:29:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9" returned: 0 in 0.466s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:29:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:29:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:29:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aef9c3b-d6e7-476c-bf4f-b42a446502a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1266da26-362d-485a-a2f8-79f9cda396a9', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ec6ddf-4b27-43ad-b024-a9d9652e0eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:39 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Volume volume-1266da26-362d-485a-a2f8-79f9cda396a9 (1266da26-362d-485a-a2f8-79f9cda396a9): created successfully Jul 15 18:29:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ec6ddf-4b27-43ad-b024-a9d9652e0eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Flow 'volume_create_manager' (7892c565-901e-4c57-a6da-acc684952f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:29:39 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-93658a36-f3c5-46cb-8fc0-09dd868e5114 tempest-TaggedAttachmentsTest-1253120024 None] Created volume successfully. Jul 15 18:29:49 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:29:49 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Flow 'volume_create_manager' (cce778d5-4e43-4a3d-be21-0cf62a4de3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bed9f4-b847-4ad6-8966-d1ed64e5dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bed9f4-b847-4ad6-8966-d1ed64e5dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2003673430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5dd44b-c073-42bf-90d6-8fc677f11efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec03029dd1be4088960045f09bc1eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:29:51Z,use_quota=True,user_id='5e6ba5ce058247c49d0c48bd38c24114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e74b5b-ec85-4805-bff2-d93576db6426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e74b5b-ec85-4805-bff2-d93576db6426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299215f8-8950-4b31-8d0a-32a3b566091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299215f8-8950-4b31-8d0a-32a3b566091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5dd44b-c073-42bf-90d6-8fc677f11efe', 'volume_name': 'volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d262e0c-04b2-4653-976a-6bec85067298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d262e0c-04b2-4653-976a-6bec85067298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c063b80-9531-4f81-8535-efca5c406975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:51 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Volume dd5dd44b-c073-42bf-90d6-8fc677f11efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe', 'volume_size': 1} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2003673430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5dd44b-c073-42bf-90d6-8fc677f11efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec03029dd1be4088960045f09bc1eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:29:51Z,use_quota=True,user_id='5e6ba5ce058247c49d0c48bd38c24114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Creating volume dd5dd44b-c073-42bf-90d6-8fc677f11efe {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:29:51 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:29:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:29:51 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe 1073741824 Jul 15 18:29:51 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:29:52 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Jul 15 18:29:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe 1073741824" returned: 0 in 1.377s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:29:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:29:52 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe Jul 15 18:29:52 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:29:53 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Jul 15 18:29:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe" returned: 0 in 0.554s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:29:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:29:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:29:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c063b80-9531-4f81-8535-efca5c406975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1aad69-0da8-4818-9dc5-f4fa5d971143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:29:53 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Volume volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe (dd5dd44b-c073-42bf-90d6-8fc677f11efe): created successfully Jul 15 18:29:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1aad69-0da8-4818-9dc5-f4fa5d971143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:29:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Flow 'volume_create_manager' (cce778d5-4e43-4a3d-be21-0cf62a4de3e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:29:53 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9cbf358e-4a36-4596-b499-d6a3ad0844bf tempest-DeleteServersTestJSON-1834479500 None] Created volume successfully. Jul 15 18:30:03 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:30:03 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:30:03 devstack cinder-volume[87863]: WARNING py.warnings [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 15 18:30:03 devstack cinder-volume[87863]: .first() Jul 15 18:30:03 devstack cinder-volume[87863]: Jul 15 18:30:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:03 devstack cinder-volume[87863]: INFO oslo.privsep.daemon [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2svncauj/privsep.sock'] Jul 15 18:30:04 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2svncauj/privsep.sock Jul 15 18:30:04 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:05 devstack cinder-volume[87863]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 15 18:30:05 devstack cinder-volume[87863]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 15 18:30:05 devstack cinder-volume[87863]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 15 18:30:05 devstack cinder-volume[87863]: WARNING oslo.privsep.daemon [-] privsep log: Jul 15 18:30:05 devstack cinder-volume[87863]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 15 18:30:05 devstack cinder-volume[87863]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 15 18:30:05 devstack cinder-volume[87863]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 15 18:30:05 devstack cinder-volume[87863]: WARNING oslo.privsep.daemon [-] privsep log: Jul 15 18:30:05 devstack cinder-volume[87863]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 15 18:30:05 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:05 devstack cinder-volume[87863]: INFO oslo.privsep.daemon [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] Spawned new privsep daemon via rootwrap Jul 15 18:30:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] Accepted privsep connection to /tmp/tmp2svncauj/privsep.sock {{(pid=87863) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 15 18:30:05 devstack cinder-volume[87863]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 15 18:30:05 devstack cinder-volume[87863]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 15 18:30:05 devstack cinder-volume[87863]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 15 18:30:05 devstack cinder-volume[87863]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89013 Jul 15 18:30:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7a33a5-289b-4c1c-8087-90aed1c681a2]: (2,) {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:30:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[768dc5b2-af12-4e62-b377-e6ffb94c36f8]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:30:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:06 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe Jul 15 18:30:06 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:06 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe" returned: 0 in 0.805s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.833s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59afee52-4f11-47a1-85f8-c18b028326a4', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:30:07 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-9c758335-b61b-4950-9f38-833c73f6eaf9 req-9b18471c-f328-4c79-a595-d14456a9b6ed tempest-DeleteServersTestJSON-1834479500 None] attachment_update completed successfully. Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Flow 'volume_create_manager' (0bd08a1a-ca22-48a8-a666-1590cbba7ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942f8aab-4417-4edf-824a-5542d967e843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942f8aab-4417-4edf-824a-5542d967e843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-486749171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec80f320-2c14-4744-bf57-b73795b0ba21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c022cd83841b8a786feddb0708fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:30:14Z,use_quota=True,user_id='db3c092403184a35b6dc23f85a093aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9375d48a-a289-4394-ad3c-2b64af8a3870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9375d48a-a289-4394-ad3c-2b64af8a3870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057b77b6-ded5-4fb8-86c7-ecbf213a06c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057b77b6-ded5-4fb8-86c7-ecbf213a06c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec80f320-2c14-4744-bf57-b73795b0ba21', 'volume_name': 'volume-ec80f320-2c14-4744-bf57-b73795b0ba21', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dc32ba-07d7-4d29-8b19-a48332890ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dc32ba-07d7-4d29-8b19-a48332890ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbad2b9-6b82-433f-9371-ab8729dfa437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:14 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Volume ec80f320-2c14-4744-bf57-b73795b0ba21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec80f320-2c14-4744-bf57-b73795b0ba21', 'volume_size': 1} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-486749171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec80f320-2c14-4744-bf57-b73795b0ba21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960c022cd83841b8a786feddb0708fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:30:14Z,use_quota=True,user_id='db3c092403184a35b6dc23f85a093aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Creating volume ec80f320-2c14-4744-bf57-b73795b0ba21 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:30:14 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:30:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:14 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21 1073741824 Jul 15 18:30:14 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:15 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21 1073741824" returned: 0 in 1.312s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:16 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21 Jul 15 18:30:16 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:16 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21" returned: 0 in 0.398s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:30:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbad2b9-6b82-433f-9371-ab8729dfa437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec80f320-2c14-4744-bf57-b73795b0ba21', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904b0324-074b-4bb2-980c-6838cfda7c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:16 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Volume volume-ec80f320-2c14-4744-bf57-b73795b0ba21 (ec80f320-2c14-4744-bf57-b73795b0ba21): created successfully Jul 15 18:30:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904b0324-074b-4bb2-980c-6838cfda7c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Flow 'volume_create_manager' (0bd08a1a-ca22-48a8-a666-1590cbba7ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:16 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a14ec035-20ff-4577-8da5-d603b229728a tempest-ServerRescueNegativeTestJSON-676380598 None] Created volume successfully. Jul 15 18:30:17 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-799db427-eb49-4c14-93ca-3f1f6f3c4ed8 req-fce568b6-6b43-4526-b14e-368a06cf29ee tempest-DeleteServersTestJSON-1834479500 None] Terminate volume connection completed successfully. Jul 15 18:30:17 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-799db427-eb49-4c14-93ca-3f1f6f3c4ed8 req-fce568b6-6b43-4526-b14e-368a06cf29ee tempest-DeleteServersTestJSON-1834479500 None] Deleting attachment 59afee52-4f11-47a1-85f8-c18b028326a4. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:30:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Acquiring lock "cinder-dd5dd44b-c073-42bf-90d6-8fc677f11efe-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:30:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Lock "cinder-dd5dd44b-c073-42bf-90d6-8fc677f11efe-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:30:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Acquiring lock "cinder-quobyte-dd5dd44b-c073-42bf-90d6-8fc677f11efe" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:30:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Lock "cinder-quobyte-dd5dd44b-c073-42bf-90d6-8fc677f11efe" acquired by "delete_volume" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:30:22 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f011fbe-8b8f-4b8b-8ea9-ae60921a1e08]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:30:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:22 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe Jul 15 18:30:22 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:23 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe" returned: 0 in 0.861s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:23 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe Jul 15 18:30:23 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:24 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dd5dd44b-c073-42bf-90d6-8fc677f11efe" returned: 0 in 0.439s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Lock "cinder-quobyte-dd5dd44b-c073-42bf-90d6-8fc677f11efe" released by "delete_volume" :: held 1.385s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:30:24 devstack cinder-volume[87863]: WARNING cinder.quota [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:30:24 devstack cinder-volume[87863]: WARNING cinder.quota [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Created reservations ['bef102d3-591d-458d-b2ad-9736b089f915', '4edd5c1d-fc1f-409f-9907-f6ad1d179510', 'b15ba55c-db47-4e14-bc29-4086f9332c28', '336e1288-7289-4328-ad93-04601fdf3f2f'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:24 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:30:24 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:24 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.516s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:24 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:30:24 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Deleted volume successfully. Jul 15 18:30:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a4ca70dd-1409-4385-802a-16e5ea2d374d tempest-DeleteServersTestJSON-1834479500 None] Lock "cinder-dd5dd44b-c073-42bf-90d6-8fc677f11efe-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:30:34 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:INSERT=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:30:34 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=13,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:35 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:30:35 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:35 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.557s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 8 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:30:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:30:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Acquiring lock "cinder-ec80f320-2c14-4744-bf57-b73795b0ba21-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:30:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Lock "cinder-ec80f320-2c14-4744-bf57-b73795b0ba21-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:30:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Acquiring lock "cinder-quobyte-ec80f320-2c14-4744-bf57-b73795b0ba21" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:30:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Lock "cinder-quobyte-ec80f320-2c14-4744-bf57-b73795b0ba21" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:30:37 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aafd850-b77d-43de-945e-a1df322daf81]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:30:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:37 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21 Jul 15 18:30:37 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:37 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21" returned: 0 in 0.560s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:37 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21 Jul 15 18:30:37 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:38 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ec80f320-2c14-4744-bf57-b73795b0ba21" returned: 0 in 0.570s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Lock "cinder-quobyte-ec80f320-2c14-4744-bf57-b73795b0ba21" released by "delete_volume" :: held 1.198s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:30:38 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Created reservations ['184699ec-01bd-4159-bc35-856cac907407', 'bbac7ac6-3297-4880-920e-e204c58a8abc', '852ab8d5-dc9a-4751-ae02-12ab8cd42c78', '492f1360-90df-4c25-b799-0a0706a086bb'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:30:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:38 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:30:38 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:39 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.490s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:39 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:30:39 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Deleted volume successfully. Jul 15 18:30:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5999c1a4-201a-4b03-9878-53fc9a6f1f43 tempest-ServerRescueNegativeTestJSON-676380598 None] Lock "cinder-ec80f320-2c14-4744-bf57-b73795b0ba21-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:30:49 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:30:49 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:31:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-3fa209cc-1270-4109-8062-204fd5a4df88 req-6fd9f59f-a289-4404-a9f7-9a31e60866df tempest-TaggedAttachmentsTest-1253120024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-3fa209cc-1270-4109-8062-204fd5a4df88 req-6fd9f59f-a289-4404-a9f7-9a31e60866df tempest-TaggedAttachmentsTest-1253120024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f2193e-8473-4a4c-b400-407791715c87]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3fa209cc-1270-4109-8062-204fd5a4df88 req-6fd9f59f-a289-4404-a9f7-9a31e60866df tempest-TaggedAttachmentsTest-1253120024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:05 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 Jul 15 18:31:05 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:06 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3fa209cc-1270-4109-8062-204fd5a4df88 req-6fd9f59f-a289-4404-a9f7-9a31e60866df tempest-TaggedAttachmentsTest-1253120024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9" returned: 0 in 0.638s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-3fa209cc-1270-4109-8062-204fd5a4df88 req-6fd9f59f-a289-4404-a9f7-9a31e60866df tempest-TaggedAttachmentsTest-1253120024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.675s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-3fa209cc-1270-4109-8062-204fd5a4df88 req-6fd9f59f-a289-4404-a9f7-9a31e60866df tempest-TaggedAttachmentsTest-1253120024 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-1266da26-362d-485a-a2f8-79f9cda396a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '146e8206-4354-417c-b4da-68468c981b52', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:31:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-3fa209cc-1270-4109-8062-204fd5a4df88 req-6fd9f59f-a289-4404-a9f7-9a31e60866df tempest-TaggedAttachmentsTest-1253120024 None] attachment_update completed successfully. Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Flow 'volume_create_manager' (afd1850e-86b7-40e9-a81d-f1d49b29f0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6fce92-77a5-4740-9daf-f58171235318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6fce92-77a5-4740-9daf-f58171235318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-264292496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a86a26-28de-448c-b878-7033901c569d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c4175f33444e0393995a40c496c081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:07Z,use_quota=True,user_id='59c1ed8a5d0e49afa269b1a009924ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322a5075-dfc0-4007-bd39-30d596ee8598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322a5075-dfc0-4007-bd39-30d596ee8598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a6269f-f9a2-4f4c-866d-b5eb982dd695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a6269f-f9a2-4f4c-866d-b5eb982dd695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97a86a26-28de-448c-b878-7033901c569d', 'volume_name': 'volume-97a86a26-28de-448c-b878-7033901c569d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b95125-376c-46ec-8638-4fc9fe366593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b95125-376c-46ec-8638-4fc9fe366593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9120225-17ee-41c9-a7f4-e34b23b53f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:07 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Volume 97a86a26-28de-448c-b878-7033901c569d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97a86a26-28de-448c-b878-7033901c569d', 'volume_size': 1} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-264292496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a86a26-28de-448c-b878-7033901c569d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c4175f33444e0393995a40c496c081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:07Z,use_quota=True,user_id='59c1ed8a5d0e49afa269b1a009924ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Creating volume 97a86a26-28de-448c-b878-7033901c569d {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:07 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:07 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d 1073741824 Jul 15 18:31:07 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:07 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d 1073741824" returned: 0 in 0.731s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:07 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d Jul 15 18:31:07 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:08 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d" returned: 0 in 0.334s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9120225-17ee-41c9-a7f4-e34b23b53f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a86a26-28de-448c-b878-7033901c569d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df01fe4-697c-46fe-a756-b1ef5e22b90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:08 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Volume volume-97a86a26-28de-448c-b878-7033901c569d (97a86a26-28de-448c-b878-7033901c569d): created successfully Jul 15 18:31:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df01fe4-697c-46fe-a756-b1ef5e22b90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Flow 'volume_create_manager' (afd1850e-86b7-40e9-a81d-f1d49b29f0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:08 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-1f4f4e1f-c53e-49e9-aab2-110e45a4aeb0 req-1eb5a32d-a694-4b09-9e7c-4406c3cc5a9c tempest-VolumesSnapshotsTestJSON-1266997809 None] Created volume successfully. Jul 15 18:31:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Creating offline snapshot 5259c63f-9028-4fff-b79c-44dfaaffb99b of volume 97a86a26-28de-448c-b878-7033901c569d {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:31:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabf7f34-eea7-48e1-9d42-229b76e44f38]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:09 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d Jul 15 18:31:09 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:10 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d" returned: 0 in 0.577s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:10 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b 1G Jul 15 18:31:10 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:10 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b 1G" returned: 0 in 0.691s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97a86a26-28de-448c-b878-7033901c569d -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:10 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97a86a26-28de-448c-b878-7033901c569d -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b Jul 15 18:31:10 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:11 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-95d48313-3b47-4d47-a5dc-5b7237257411 req-b017b18f-776e-4d31-98f9-b09325e5c0d3 tempest-TaggedAttachmentsTest-1253120024 None] Terminate volume connection completed successfully. Jul 15 18:31:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-95d48313-3b47-4d47-a5dc-5b7237257411 req-b017b18f-776e-4d31-98f9-b09325e5c0d3 tempest-TaggedAttachmentsTest-1253120024 None] Deleting attachment 146e8206-4354-417c-b4da-68468c981b52. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:31:11 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97a86a26-28de-448c-b878-7033901c569d -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b" returned: 0 in 0.697s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:11 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b is being set with open permissions: ugo+rw Jul 15 18:31:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:11 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b Jul 15 18:31:11 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:12 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b" returned: 0 in 0.716s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:12 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.info Jul 15 18:31:12 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:12 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.info" returned: 0 in 0.389s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:12 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.info is being set with open permissions: ugo+rw Jul 15 18:31:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:12 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.info Jul 15 18:31:12 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:13 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.info" returned: 0 in 0.321s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.644s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:13 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-4f57a4b9-5ef8-46a8-803b-512fe5d9c444 req-d8f6e3a7-8929-40d5-90a6-3a0f956efe45 tempest-VolumesSnapshotsTestJSON-1266997809 None] Create snapshot completed successfully Jul 15 18:31:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Acquiring lock "cinder-5259c63f-9028-4fff-b79c-44dfaaffb99b-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "cinder-5259c63f-9028-4fff-b79c-44dfaaffb99b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Acquiring lock "cinder-quobyte-97a86a26-28de-448c-b878-7033901c569d" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "cinder-quobyte-97a86a26-28de-448c-b878-7033901c569d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Acquiring lock "cinder-quobyte-5259c63f-9028-4fff-b79c-44dfaaffb99b" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "cinder-quobyte-5259c63f-9028-4fff-b79c-44dfaaffb99b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Deleting offline snapshot 5259c63f-9028-4fff-b79c-44dfaaffb99b of volume 97a86a26-28de-448c-b878-7033901c569d {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:31:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] snapshot_file for this snap is: volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:31:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc71be7-c087-450c-82c9-d1bc3d9f477e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:14 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b Jul 15 18:31:14 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:14 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b" returned: 0 in 0.613s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97a86a26-28de-448c-b878-7033901c569d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:31:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[152ca791-96bc-4e72-93d8-1b21ea8114a5]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:14 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d Jul 15 18:31:14 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:15 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d" returned: 0 in 0.628s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:15 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b Jul 15 18:31:15 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:15 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b" returned: 0 in 0.629s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:16 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b Jul 15 18:31:16 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:16 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d.5259c63f-9028-4fff-b79c-44dfaaffb99b" returned: 0 in 0.666s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "cinder-quobyte-5259c63f-9028-4fff-b79c-44dfaaffb99b" released by "_delete_snapshot" :: held 2.754s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "cinder-quobyte-97a86a26-28de-448c-b878-7033901c569d" released by "delete_snapshot" :: held 2.805s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:16 devstack cinder-volume[87863]: WARNING cinder.quota [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:31:16 devstack cinder-volume[87863]: DEBUG cinder.quota [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Created reservations ['23731d28-a285-4dec-8b8a-b9dc0b7f09e9', '8a12905c-a9d3-47c0-9604-9705c53a138a', 'd0fd8f5a-ccee-4070-a260-38dcc14bceb0', '6350c943-9761-4417-85e2-c1ce142e38c7'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:16 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Delete snapshot completed successfully. Jul 15 18:31:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-da100b20-e8d3-4b7c-af1d-fa7ee52062e2 req-0098ce4f-2216-4857-b802-4ffd07a221f4 tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "cinder-5259c63f-9028-4fff-b79c-44dfaaffb99b-delete_snapshot" released by "delete_snapshot" :: held 3.131s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Acquiring lock "cinder-97a86a26-28de-448c-b878-7033901c569d-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "cinder-97a86a26-28de-448c-b878-7033901c569d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Acquiring lock "cinder-quobyte-97a86a26-28de-448c-b878-7033901c569d" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "cinder-quobyte-97a86a26-28de-448c-b878-7033901c569d" acquired by "delete_volume" :: waited 0.034s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:18 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff94474-c575-4729-ae3a-c7cb8c518226]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:18 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d Jul 15 18:31:18 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:18 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d" returned: 0 in 0.547s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:18 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d Jul 15 18:31:18 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:18 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-97a86a26-28de-448c-b878-7033901c569d" returned: 0 in 0.301s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "cinder-quobyte-97a86a26-28de-448c-b878-7033901c569d" released by "delete_volume" :: held 0.969s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:19 devstack cinder-volume[87863]: DEBUG cinder.quota [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Created reservations ['1a5a881b-fe64-4b7c-9c74-ca9a9b5ff11e', 'ffce4578-38e0-4499-92d2-77f487d4c2e4', 'c393f3cf-7ecb-473d-877a-9f95b3663752', '0dcd5f5c-f493-4b42-ab47-f59f43331e11'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:19 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:31:19 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:19 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.545s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:19 devstack cinder-volume[87863]: DEBUG cinder.manager [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:31:19 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Deleted volume successfully. Jul 15 18:31:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-4299aa9f-709e-45f7-a7ac-8bfa8bbc0abb req-f03ccc01-7d2e-43d9-acae-0e5f357cfb6f tempest-VolumesSnapshotsTestJSON-1266997809 None] Lock "cinder-97a86a26-28de-448c-b878-7033901c569d-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Flow 'volume_create_manager' (fad33ac2-0095-4f41-a3f1-e045e0820f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0baee52-9887-4cdb-a6be-594a8fd3cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0baee52-9887-4cdb-a6be-594a8fd3cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-764424654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15628840-477e-40db-af4e-8d15a0f7ed7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c2c0a15d0404ac2817fa27ed16b1b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:27Z,use_quota=True,user_id='df1bc626605541f88cb619ee173c0174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ed76b4-ae11-46d7-ad24-38281dc12652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ed76b4-ae11-46d7-ad24-38281dc12652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c440b3c-8b14-43cd-bab7-9c335b946fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c440b3c-8b14-43cd-bab7-9c335b946fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15628840-477e-40db-af4e-8d15a0f7ed7b', 'volume_name': 'volume-15628840-477e-40db-af4e-8d15a0f7ed7b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589e6f92-08c6-482c-979e-80bf0094c126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589e6f92-08c6-482c-979e-80bf0094c126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e27cbc-88f5-484c-bcda-e3af2117270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:27 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Volume 15628840-477e-40db-af4e-8d15a0f7ed7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15628840-477e-40db-af4e-8d15a0f7ed7b', 'volume_size': 1} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-764424654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15628840-477e-40db-af4e-8d15a0f7ed7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c2c0a15d0404ac2817fa27ed16b1b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:27Z,use_quota=True,user_id='df1bc626605541f88cb619ee173c0174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Creating volume 15628840-477e-40db-af4e-8d15a0f7ed7b {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:27 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:31:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:27 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b 1073741824 Jul 15 18:31:27 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:28 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b 1073741824" returned: 0 in 0.621s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:28 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b Jul 15 18:31:28 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Acquiring lock "cinder-1266da26-362d-485a-a2f8-79f9cda396a9-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Lock "cinder-1266da26-362d-485a-a2f8-79f9cda396a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:28 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Acquiring lock "cinder-quobyte-1266da26-362d-485a-a2f8-79f9cda396a9" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b" returned: 0 in 0.378s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e27cbc-88f5-484c-bcda-e3af2117270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15628840-477e-40db-af4e-8d15a0f7ed7b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac891e1-8c6b-4fc6-a32e-23e30eddcb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Lock "cinder-quobyte-1266da26-362d-485a-a2f8-79f9cda396a9" acquired by "delete_volume" :: waited 0.038s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:28 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Volume volume-15628840-477e-40db-af4e-8d15a0f7ed7b (15628840-477e-40db-af4e-8d15a0f7ed7b): created successfully Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac891e1-8c6b-4fc6-a32e-23e30eddcb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Flow 'volume_create_manager' (fad33ac2-0095-4f41-a3f1-e045e0820f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[144e7c51-8720-4f73-917c-fc13ed5d0989]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:28 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-77098524-d925-4e1c-8729-eb83ee9cad4a req-4471b150-b80e-4f68-8957-678a182301d8 tempest-VolumesGetTestJSON-155407355 None] Created volume successfully. Jul 15 18:31:28 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 Jul 15 18:31:28 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:29 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9" returned: 0 in 0.412s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:29 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9 Jul 15 18:31:29 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:29 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1266da26-362d-485a-a2f8-79f9cda396a9" returned: 0 in 0.285s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Lock "cinder-quobyte-1266da26-362d-485a-a2f8-79f9cda396a9" released by "delete_volume" :: held 0.765s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Created reservations ['cfade1b1-130d-4909-8588-c7a544985fe9', '84575394-2c49-44c0-b937-949bca336307', 'a87f6f95-7561-4557-bae5-3d0ca646c478', '49c2f870-412b-4619-a9f8-f05748e56594'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:29 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:31:29 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Acquiring lock "cinder-15628840-477e-40db-af4e-8d15a0f7ed7b-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Lock "cinder-15628840-477e-40db-af4e-8d15a0f7ed7b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:29 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.395s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:29 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:31:29 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Deleted volume successfully. Jul 15 18:31:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Acquiring lock "cinder-quobyte-15628840-477e-40db-af4e-8d15a0f7ed7b" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Lock "cinder-quobyte-15628840-477e-40db-af4e-8d15a0f7ed7b" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2f682465-e4d6-4965-a0fd-32e5ae76ec79 tempest-TaggedAttachmentsTest-1253120024 None] Lock "cinder-1266da26-362d-485a-a2f8-79f9cda396a9-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:30 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a4d85d-46bf-4eca-9fc8-a4a5d8caede0]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:30 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b Jul 15 18:31:30 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:30 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b" returned: 0 in 0.461s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:30 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b Jul 15 18:31:30 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:30 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-15628840-477e-40db-af4e-8d15a0f7ed7b" returned: 0 in 0.293s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Lock "cinder-quobyte-15628840-477e-40db-af4e-8d15a0f7ed7b" released by "delete_volume" :: held 0.822s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:30 devstack cinder-volume[87863]: DEBUG cinder.quota [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Created reservations ['2998b177-4536-499e-a85e-e6c019e40946', '461ea46b-39b1-4917-9de2-bfab475402a1', 'b01666ef-0e13-4526-91e8-639c023f8f7c', 'f84aff80-7871-42c1-abae-071095612d27'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:31 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:31:31 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:31 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.391s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:31 devstack cinder-volume[87863]: DEBUG cinder.manager [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:31:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Deleted volume successfully. Jul 15 18:31:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3e82b71d-7d58-47b1-bef6-bcf3df03a322 req-a92efa30-134c-47f3-9d13-2b39f00088c6 tempest-VolumesGetTestJSON-155407355 None] Lock "cinder-15628840-477e-40db-af4e-8d15a0f7ed7b-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:35 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:31:35 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:35 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.613s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 8 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:31:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:31:40 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Flow 'volume_create_manager' (781c4aba-8664-4f69-bcc4-e1263704bb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2687db89-7bbc-481b-a268-99053beb716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2687db89-7bbc-481b-a268-99053beb716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-524745371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fadb646984ba583b497cf262d34e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:41Z,use_quota=True,user_id='426084e1385f4e59ac4380fdf950b6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c14d54-5c07-444f-9e84-ae7c77087c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c14d54-5c07-444f-9e84-ae7c77087c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3593d9cc-8d3b-4e31-bb5b-18943f4c7918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3593d9cc-8d3b-4e31-bb5b-18943f4c7918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a', 'volume_name': 'volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6e6cca-b2fa-4d23-b0bf-88c78e1d9ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6e6cca-b2fa-4d23-b0bf-88c78e1d9ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96d83a7-cb22-4f69-a949-1e24bd967dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:41 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Volume 02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a', 'volume_size': 1} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-524745371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fadb646984ba583b497cf262d34e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:41Z,use_quota=True,user_id='426084e1385f4e59ac4380fdf950b6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Creating volume 02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:41 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:31:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:41 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a 1073741824 Jul 15 18:31:41 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:42 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a 1073741824" returned: 0 in 0.827s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:42 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a Jul 15 18:31:42 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:42 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a" returned: 0 in 0.365s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96d83a7-cb22-4f69-a949-1e24bd967dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1668594b-f4e3-412a-a5b4-cb55373bcd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:42 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Volume volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a (02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a): created successfully Jul 15 18:31:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1668594b-f4e3-412a-a5b4-cb55373bcd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Flow 'volume_create_manager' (781c4aba-8664-4f69-bcc4-e1263704bb5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:42 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ad4fb5a7-cae0-44d0-82fd-e261c85b828e tempest-ServerActionsTestOtherA-851711418 None] Created volume successfully. Jul 15 18:31:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-134f1373-e6c5-4d11-9985-b13bbd5a30b2 tempest-GroupSnapshotsTest-211943275 None] Group tempest-GroupSnapshotsTest-Group-1312416988: creating Jul 15 18:31:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-134f1373-e6c5-4d11-9985-b13bbd5a30b2 tempest-GroupSnapshotsTest-211943275 None] Group tempest-GroupSnapshotsTest-Group-1312416988: created successfully Jul 15 18:31:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-134f1373-e6c5-4d11-9985-b13bbd5a30b2 tempest-GroupSnapshotsTest-211943275 None] Create group completed successfully. Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Flow 'volume_create_manager' (d4242a35-99c5-446b-af23-421ea4ce1ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b38f312-00ec-4725-affe-6b9d54eef18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b38f312-00ec-4725-affe-6b9d54eef18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1279922623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0811422a-e232-4558-ac89-e6f8e45dc626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d6788022224d4884f6e6f90fd44c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:47Z,use_quota=True,user_id='28e5b839996d41298f6e6395be2c2818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af578844-be32-4a4a-b437-beed505d228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af578844-be32-4a4a-b437-beed505d228f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5b8f06-2aa1-498c-8d52-c82c52ab6c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5b8f06-2aa1-498c-8d52-c82c52ab6c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0811422a-e232-4558-ac89-e6f8e45dc626', 'volume_name': 'volume-0811422a-e232-4558-ac89-e6f8e45dc626', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4656b0fa-b006-42b8-ad16-494fe3e70dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4656b0fa-b006-42b8-ad16-494fe3e70dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c039eb03-22e3-4404-a885-98dd5e6a73d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:46 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Volume 0811422a-e232-4558-ac89-e6f8e45dc626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0811422a-e232-4558-ac89-e6f8e45dc626', 'volume_size': 1} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1279922623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0811422a-e232-4558-ac89-e6f8e45dc626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d6788022224d4884f6e6f90fd44c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:47Z,use_quota=True,user_id='28e5b839996d41298f6e6395be2c2818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Creating volume 0811422a-e232-4558-ac89-e6f8e45dc626 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:46 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:31:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:46 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626 1073741824 Jul 15 18:31:46 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:47 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626 1073741824" returned: 0 in 0.798s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:47 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626 Jul 15 18:31:47 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Flow 'volume_create_manager' (0fa96e94-6235-4b51-94da-c1e1c32ecc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd75f56e-0614-42e3-9bb2-a96904f5cd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd75f56e-0614-42e3-9bb2-a96904f5cd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124654563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7f930bd-150d-446e-8035-0433450aeb02,host='devstack@QuobyteHD#QuobyteHD',id=11bf1449-937f-4255-a330-0e9777056398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c153849e9c0b4eb6a3cd07d17011f252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:48Z,use_quota=True,user_id='f25fc131c9854c29a3333bd1fd4f5ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5704de58-fee4-421b-aaf8-c99991117356),volume_type_id=5704de58-fee4-421b-aaf8-c99991117356)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e329fda-3252-405f-8f3c-228f86dcac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e329fda-3252-405f-8f3c-228f86dcac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63065fd6-d8b5-4aad-a0a5-b972896b31e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63065fd6-d8b5-4aad-a0a5-b972896b31e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11bf1449-937f-4255-a330-0e9777056398', 'volume_name': 'volume-11bf1449-937f-4255-a330-0e9777056398', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0844f1d2-0468-4178-948f-8424c3892799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0844f1d2-0468-4178-948f-8424c3892799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8152c82-3df3-4e83-a580-ed3ba1e31972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:47 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Volume 11bf1449-937f-4255-a330-0e9777056398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11bf1449-937f-4255-a330-0e9777056398', 'volume_size': 1} Jul 15 18:31:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:48 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626" returned: 0 in 0.503s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a7f930bd-150d-446e-8035-0433450aeb02,created_at=2026-07-15T16:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124654563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7f930bd-150d-446e-8035-0433450aeb02,host='devstack@QuobyteHD#QuobyteHD',id=11bf1449-937f-4255-a330-0e9777056398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c153849e9c0b4eb6a3cd07d17011f252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:48Z,use_quota=True,user_id='f25fc131c9854c29a3333bd1fd4f5ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5704de58-fee4-421b-aaf8-c99991117356),volume_type_id=5704de58-fee4-421b-aaf8-c99991117356)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Creating volume 11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:48 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:48 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 1073741824 Jul 15 18:31:48 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c039eb03-22e3-4404-a885-98dd5e6a73d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0811422a-e232-4558-ac89-e6f8e45dc626', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2eb222-173a-49b0-bbd6-7a4e7ffaa6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:48 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Volume volume-0811422a-e232-4558-ac89-e6f8e45dc626 (0811422a-e232-4558-ac89-e6f8e45dc626): created successfully Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2eb222-173a-49b0-bbd6-7a4e7ffaa6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Flow 'volume_create_manager' (d4242a35-99c5-446b-af23-421ea4ce1ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bead0b6d-cd35-4ef0-a206-e327d61b4046 tempest-VolumesAdminNegativeTest-804876722 None] Created volume successfully. Jul 15 18:31:49 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 1073741824" returned: 0 in 0.975s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:49 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 Jul 15 18:31:49 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:49 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Acquiring lock "cinder-0811422a-e232-4558-ac89-e6f8e45dc626-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398" returned: 0 in 0.609s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Lock "cinder-0811422a-e232-4558-ac89-e6f8e45dc626-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8152c82-3df3-4e83-a580-ed3ba1e31972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11bf1449-937f-4255-a330-0e9777056398', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd8b07d-cdf8-4e80-b229-da26f360f748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:49 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Volume volume-11bf1449-937f-4255-a330-0e9777056398 (11bf1449-937f-4255-a330-0e9777056398): created successfully Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd8b07d-cdf8-4e80-b229-da26f360f748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Flow 'volume_create_manager' (0fa96e94-6235-4b51-94da-c1e1c32ecc9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-dd6d4e19-db39-4407-8e24-9756b940b019 tempest-GroupSnapshotsTest-211943275 None] Created volume successfully. Jul 15 18:31:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Acquiring lock "cinder-quobyte-0811422a-e232-4558-ac89-e6f8e45dc626" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Lock "cinder-quobyte-0811422a-e232-4558-ac89-e6f8e45dc626" acquired by "delete_volume" :: waited 0.038s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:50 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9ded91-8586-4105-8df4-2a1bbe6aac68]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:50 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626 Jul 15 18:31:50 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:50 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626" returned: 0 in 0.616s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:50 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626 Jul 15 18:31:50 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:51 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0811422a-e232-4558-ac89-e6f8e45dc626" returned: 0 in 0.460s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Lock "cinder-quobyte-0811422a-e232-4558-ac89-e6f8e45dc626" released by "delete_volume" :: held 1.181s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Created reservations ['db58b863-32d0-46b7-9392-53a500303be4', '511bb0c9-eed3-42c3-a5af-38a77035b554', '548ce356-da21-4d29-bed5-99258aa76e35', '2bc56a76-319f-4693-b123-b605029f5390'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:51 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] GroupSnapshot 94ec1c1d-720d-475e-9437-0376a53a666a: creating. Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Group snapshot 94ec1c1d-720d-475e-9437-0376a53a666a: creating. {{(pid=87863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:51 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:31:51 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Creating offline snapshot 44b26305-0566-42ce-9ef0-ee86aa19f1e3 of volume 11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[56db6338-d14f-4f0d-aa7b-a8773ac1a8bd]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:52 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 Jul 15 18:31:52 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:52 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.544s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:52 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:31:52 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Deleted volume successfully. Jul 15 18:31:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4d3967e-702a-4108-837f-9891af7ffbf2 tempest-VolumesAdminNegativeTest-804876722 None] Lock "cinder-0811422a-e232-4558-ac89-e6f8e45dc626-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:52 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398" returned: 0 in 1.066s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:52 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 1G Jul 15 18:31:52 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:53 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 1G" returned: 0 in 0.785s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11bf1449-937f-4255-a330-0e9777056398 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:53 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11bf1449-937f-4255-a330-0e9777056398 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 Jul 15 18:31:53 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:54 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11bf1449-937f-4255-a330-0e9777056398 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3" returned: 0 in 0.409s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:54 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:31:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:54 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 Jul 15 18:31:54 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:54 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3" returned: 0 in 0.301s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:54 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.info Jul 15 18:31:54 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:54 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.info" returned: 0 in 0.312s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:54 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:31:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:54 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.info Jul 15 18:31:54 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:55 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.info" returned: 0 in 0.349s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.391s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:55 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-893f2b8d-1f9a-48eb-bae5-05615d109478 tempest-GroupSnapshotsTest-211943275 None] group_snapshot 94ec1c1d-720d-475e-9437-0376a53a666a: created successfully Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-44b26305-0566-42ce-9ef0-ee86aa19f1e3-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" by "_create_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-44b26305-0566-42ce-9ef0-ee86aa19f1e3-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Creating volume e4e95b4c-8bf8-4561-872d-c4dad294f3c3 from snapshot 44b26305-0566-42ce-9ef0-ee86aa19f1e3 {{(pid=87863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] snapshot: 44b26305-0566-42ce-9ef0-ee86aa19f1e3, volume: e4e95b4c-8bf8-4561-872d-c4dad294f3c3, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50abfc3-4dd6-47c1-810f-ade817f6706d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:58 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 Jul 15 18:31:58 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:58 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3" returned: 0 in 0.926s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11bf1449-937f-4255-a330-0e9777056398(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:31:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:31:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:31:58 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[49852530-c541-4ef8-920c-b7be401a1e59]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:58 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 Jul 15 18:31:58 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:59 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398" returned: 0 in 0.630s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:59 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:31:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:59 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 Jul 15 18:31:59 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:07 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=53,cinder:UPDATE=56,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:32:07 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" returned: 0 in 8.264s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f984c-a63b-4827-a95e-376bd8d10acd]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:07 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=58,cinder:UPDATE=61,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:32:07 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 Jul 15 18:32:07 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:08 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398" returned: 0 in 0.993s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:08 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398, size 1024.00 MB, duration 8.27 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:32:08 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Converted 1024.00 MB image at 123.89 MB/s Jul 15 18:32:08 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:32:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:08 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 Jul 15 18:32:08 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:09 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" returned: 0 in 0.349s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" released by "_copy_volume_from_snapshot" :: held 11.347s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-44b26305-0566-42ce-9ef0-ee86aa19f1e3-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" released by "_create_volume_from_snapshot" :: held 11.409s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.439s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:09 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2415f429-cf46-4669-973c-96c57c87c569 tempest-GroupSnapshotsTest-211943275 None] Create group from source-snapshot-94ec1c1d-720d-475e-9437-0376a53a666a completed successfully. Jul 15 18:32:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" acquired by "delete_volume" :: waited 0.038s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8783d10-0944-4e8f-bc95-2d453f7600c6]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:10 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 Jul 15 18:32:10 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:11 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" returned: 0 in 0.725s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:11 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3 Jul 15 18:32:11 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:11 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" returned: 0 in 0.306s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-e4e95b4c-8bf8-4561-872d-c4dad294f3c3" released by "delete_volume" :: held 1.126s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Created reservations ['a95e69f6-6993-4ac2-8308-f0bfcab97475'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:11 devstack cinder-volume[87863]: WARNING cinder.quota [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1222420054 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1222420054, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:11 devstack cinder-volume[87863]: WARNING cinder.quota [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1222420054 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1222420054, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Created reservations ['170dc514-f65f-4014-a30e-479da98101ed', '2b38123c-0801-4ab7-84bb-1b59ad710e25', '8aa70d97-8f5b-4096-802b-2d0070d35548', '94f52741-35dd-4d31-8f19-caa3c5ef0350'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:11 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:32:11 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:12 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.254s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:12 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:12 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bc075bcb-7821-4a5a-bb91-0807e6e81c06 tempest-GroupSnapshotsTest-211943275 None] Delete group completed successfully. Jul 15 18:32:12 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] group_snapshot 94ec1c1d-720d-475e-9437-0376a53a666a: deleting Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] group_snapshot 94ec1c1d-720d-475e-9437-0376a53a666a: deleting {{(pid=87863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-11bf1449-937f-4255-a330-0e9777056398" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-11bf1449-937f-4255-a330-0e9777056398" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-44b26305-0566-42ce-9ef0-ee86aa19f1e3" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-44b26305-0566-42ce-9ef0-ee86aa19f1e3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Deleting offline snapshot 44b26305-0566-42ce-9ef0-ee86aa19f1e3 of volume 11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] snapshot_file for this snap is: volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d82987-d437-4cd1-a1a9-0479377942d0]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:13 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 Jul 15 18:32:13 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:13 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3" returned: 0 in 0.537s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11bf1449-937f-4255-a330-0e9777056398(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c882e9-5eb4-464b-9d21-78cc71cc8b60]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:13 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 Jul 15 18:32:13 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:14 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398" returned: 0 in 0.499s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:14 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 Jul 15 18:32:14 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:14 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3" returned: 0 in 0.561s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:14 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3 Jul 15 18:32:14 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:15 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398.44b26305-0566-42ce-9ef0-ee86aa19f1e3" returned: 0 in 0.467s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-44b26305-0566-42ce-9ef0-ee86aa19f1e3" released by "_delete_snapshot" :: held 2.248s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-11bf1449-937f-4255-a330-0e9777056398" released by "delete_snapshot" :: held 2.284s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:15 devstack cinder-volume[87863]: WARNING cinder.quota [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1222420054 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1222420054, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:15 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] Created reservations ['9a2c26be-5850-4466-a57f-b8754bb30b49', '81109860-4562-400f-ba77-d5babc00a6ad', '8c941617-2a02-4de9-a005-c033f279e11a', '5728504d-0fc3-4451-9652-1b59069eed64'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:15 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1dd628e5-aab4-49b2-a46e-9048307da66c tempest-GroupSnapshotsTest-211943275 None] group_snapshot 94ec1c1d-720d-475e-9437-0376a53a666a: deleted successfully Jul 15 18:32:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-11bf1449-937f-4255-a330-0e9777056398" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-11bf1449-937f-4255-a330-0e9777056398" acquired by "delete_volume" :: waited 0.033s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:16 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[362f5d78-20a8-4e14-950c-2334c59fefa3]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:17 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 Jul 15 18:32:17 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:17 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398" returned: 0 in 0.475s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:17 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398 Jul 15 18:32:17 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:17 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11bf1449-937f-4255-a330-0e9777056398" returned: 0 in 0.418s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-11bf1449-937f-4255-a330-0e9777056398" released by "delete_volume" :: held 1.004s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:18 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Created reservations ['e7e4d81b-b07f-4e93-97c1-ee885c3c7adb'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:18 devstack cinder-volume[87863]: WARNING cinder.db.api [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1222420054'] Jul 15 18:32:18 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Created reservations ['62acda10-30a2-4f27-8153-63bd337029b0', '5cee6453-5a99-43d5-91ee-8451a0b76383', '7753eca6-3e1f-4dca-ab8c-2ccd89ff216a', 'cccd8414-3aac-448b-a2c5-a5c0e6582836'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:18 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:32:18 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:18 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.270s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:18 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:18 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5d334a20-98fa-4b20-96ec-eeaa6865c35b tempest-GroupSnapshotsTest-211943275 None] Delete group completed successfully. Jul 15 18:32:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-66d4153c-8387-4402-a440-0f840c59a99f tempest-GroupSnapshotsTest-211943275 None] Group tempest-GroupSnapshotsTest-Group-1347651945: creating Jul 15 18:32:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-66d4153c-8387-4402-a440-0f840c59a99f tempest-GroupSnapshotsTest-211943275 None] Group tempest-GroupSnapshotsTest-Group-1347651945: created successfully Jul 15 18:32:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-66d4153c-8387-4402-a440-0f840c59a99f tempest-GroupSnapshotsTest-211943275 None] Create group completed successfully. Jul 15 18:32:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-edb56e6f-3147-4dcf-9600-1773d6dca615 req-0779177e-b769-49f4-ba86-f43fbf1adb8a tempest-ServerActionsTestOtherA-851711418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-edb56e6f-3147-4dcf-9600-1773d6dca615 req-0779177e-b769-49f4-ba86-f43fbf1adb8a tempest-ServerActionsTestOtherA-851711418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:21 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1020098-4dd6-4246-b916-5ca6434568ab]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-edb56e6f-3147-4dcf-9600-1773d6dca615 req-0779177e-b769-49f4-ba86-f43fbf1adb8a tempest-ServerActionsTestOtherA-851711418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:21 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a Jul 15 18:32:21 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Flow 'volume_create_manager' (2e5c6782-e491-40e5-bf3d-e719d82a5dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257adf3b-1dc2-460e-b6e9-868b91d38870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257adf3b-1dc2-460e-b6e9-868b91d38870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-829583318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abaa9ac1-717c-4601-a692-e057d0d34bdf,host='devstack@QuobyteHD#QuobyteHD',id=38faf774-fdee-4d51-ab35-f2cc3b5f6947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c153849e9c0b4eb6a3cd07d17011f252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:22Z,use_quota=True,user_id='f25fc131c9854c29a3333bd1fd4f5ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c804080-a984-4829-a87e-ae24b8493a89),volume_type_id=3c804080-a984-4829-a87e-ae24b8493a89)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:22 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dde2254-1f14-4699-bf9d-932ed46f3902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dde2254-1f14-4699-bf9d-932ed46f3902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9b8f3c-c973-4d50-8e4c-e1af73de89e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9b8f3c-c973-4d50-8e4c-e1af73de89e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38faf774-fdee-4d51-ab35-f2cc3b5f6947', 'volume_name': 'volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c3d8f3-4eba-4fea-96d4-fc7e19013c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c3d8f3-4eba-4fea-96d4-fc7e19013c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d25d785-2b0f-4189-aca9-f592a63b006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:22 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Volume 38faf774-fdee-4d51-ab35-f2cc3b5f6947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947', 'volume_size': 1} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-edb56e6f-3147-4dcf-9600-1773d6dca615 req-0779177e-b769-49f4-ba86-f43fbf1adb8a tempest-ServerActionsTestOtherA-851711418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a" returned: 0 in 0.722s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-edb56e6f-3147-4dcf-9600-1773d6dca615 req-0779177e-b769-49f4-ba86-f43fbf1adb8a tempest-ServerActionsTestOtherA-851711418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.767s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=abaa9ac1-717c-4601-a692-e057d0d34bdf,created_at=2026-07-15T16:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-829583318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abaa9ac1-717c-4601-a692-e057d0d34bdf,host='devstack@QuobyteHD#QuobyteHD',id=38faf774-fdee-4d51-ab35-f2cc3b5f6947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c153849e9c0b4eb6a3cd07d17011f252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:22Z,use_quota=True,user_id='f25fc131c9854c29a3333bd1fd4f5ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c804080-a984-4829-a87e-ae24b8493a89),volume_type_id=3c804080-a984-4829-a87e-ae24b8493a89)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Creating volume 38faf774-fdee-4d51-ab35-f2cc3b5f6947 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:32:22 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:22 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 1073741824 Jul 15 18:32:22 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-edb56e6f-3147-4dcf-9600-1773d6dca615 req-0779177e-b769-49f4-ba86-f43fbf1adb8a tempest-ServerActionsTestOtherA-851711418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8533f63-5a33-42a1-9be1-b71b13b54990', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:32:22 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-edb56e6f-3147-4dcf-9600-1773d6dca615 req-0779177e-b769-49f4-ba86-f43fbf1adb8a tempest-ServerActionsTestOtherA-851711418 None] attachment_update completed successfully. Jul 15 18:32:23 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 1073741824" returned: 0 in 0.904s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:23 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 Jul 15 18:32:23 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:23 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947" returned: 0 in 0.418s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:32:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d25d785-2b0f-4189-aca9-f592a63b006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf58152e-2acb-44b0-8378-3a3bb99f751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:23 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Volume volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 (38faf774-fdee-4d51-ab35-f2cc3b5f6947): created successfully Jul 15 18:32:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf58152e-2acb-44b0-8378-3a3bb99f751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Flow 'volume_create_manager' (2e5c6782-e491-40e5-bf3d-e719d82a5dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:23 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4e6f31e9-0033-498b-af09-eb3fa310abcb tempest-GroupSnapshotsTest-211943275 None] Created volume successfully. Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Flow 'volume_create_manager' (5e5817b0-5e65-4513-9ac7-6b09690af249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8a8a2e-b5d8-4907-be41-9ad4f9981a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8a8a2e-b5d8-4907-be41-9ad4f9981a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-29250395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abaa9ac1-717c-4601-a692-e057d0d34bdf,host='devstack@QuobyteHD#QuobyteHD',id=2b0a9176-0d78-4f8f-9c9f-dd187020fc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c153849e9c0b4eb6a3cd07d17011f252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:25Z,use_quota=True,user_id='f25fc131c9854c29a3333bd1fd4f5ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c804080-a984-4829-a87e-ae24b8493a89),volume_type_id=3c804080-a984-4829-a87e-ae24b8493a89)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0cd8162-53f3-431d-9d7e-30ad6a386022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0cd8162-53f3-431d-9d7e-30ad6a386022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da8f2bd-4a35-4a06-81eb-d240a5622305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da8f2bd-4a35-4a06-81eb-d240a5622305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b0a9176-0d78-4f8f-9c9f-dd187020fc94', 'volume_name': 'volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28431ff1-bc15-4574-930e-bbd0b8234187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28431ff1-bc15-4574-930e-bbd0b8234187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14af34a7-5793-40a7-bd8b-5b2d2c8f74b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:25 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Volume 2b0a9176-0d78-4f8f-9c9f-dd187020fc94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94', 'volume_size': 1} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=abaa9ac1-717c-4601-a692-e057d0d34bdf,created_at=2026-07-15T16:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-29250395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abaa9ac1-717c-4601-a692-e057d0d34bdf,host='devstack@QuobyteHD#QuobyteHD',id=2b0a9176-0d78-4f8f-9c9f-dd187020fc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c153849e9c0b4eb6a3cd07d17011f252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:25Z,use_quota=True,user_id='f25fc131c9854c29a3333bd1fd4f5ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c804080-a984-4829-a87e-ae24b8493a89),volume_type_id=3c804080-a984-4829-a87e-ae24b8493a89)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Creating volume 2b0a9176-0d78-4f8f-9c9f-dd187020fc94 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:32:25 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:32:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:25 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 1073741824 Jul 15 18:32:25 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:26 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 1073741824" returned: 0 in 0.689s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:26 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 Jul 15 18:32:26 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:26 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" returned: 0 in 0.704s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:32:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14af34a7-5793-40a7-bd8b-5b2d2c8f74b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3027ace7-ae7e-4def-be3b-4c8c827c5d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:27 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Volume volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 (2b0a9176-0d78-4f8f-9c9f-dd187020fc94): created successfully Jul 15 18:32:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3027ace7-ae7e-4def-be3b-4c8c827c5d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Flow 'volume_create_manager' (5e5817b0-5e65-4513-9ac7-6b09690af249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9aacfa07-88bf-4f7d-a29d-709ac6a4668b tempest-GroupSnapshotsTest-211943275 None] Created volume successfully. Jul 15 18:32:28 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5e2ce681-10fd-48ce-b7c4-9d920beb65d7 tempest-GroupSnapshotsTest-211943275 None] Update group completed successfully. Jul 15 18:32:29 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-c6f7b2a2-78fa-4d76-a320-607064e2f607 req-a83940a2-38a1-44e6-9b90-f198382858ae tempest-ServerActionsTestOtherA-851711418 None] Terminate volume connection completed successfully. Jul 15 18:32:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-c6f7b2a2-78fa-4d76-a320-607064e2f607 req-a83940a2-38a1-44e6-9b90-f198382858ae tempest-ServerActionsTestOtherA-851711418 None] Deleting attachment d8533f63-5a33-42a1-9be1-b71b13b54990. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:32:30 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-66f48d67-2e33-43b7-853b-cc390ef741e8 tempest-GroupSnapshotsTest-211943275 None] Update group completed successfully. Jul 15 18:32:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-c6f7b2a2-78fa-4d76-a320-607064e2f607 req-9e22ec94-d37f-4bea-975f-b396f6f16f58 tempest-ServerActionsTestOtherA-851711418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-c6f7b2a2-78fa-4d76-a320-607064e2f607 req-9e22ec94-d37f-4bea-975f-b396f6f16f58 tempest-ServerActionsTestOtherA-851711418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:30 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e810175-4703-4c92-bbed-ccafd0288dce]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-c6f7b2a2-78fa-4d76-a320-607064e2f607 req-9e22ec94-d37f-4bea-975f-b396f6f16f58 tempest-ServerActionsTestOtherA-851711418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:30 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a Jul 15 18:32:30 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:31 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-c6f7b2a2-78fa-4d76-a320-607064e2f607 req-9e22ec94-d37f-4bea-975f-b396f6f16f58 tempest-ServerActionsTestOtherA-851711418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a" returned: 0 in 0.645s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-c6f7b2a2-78fa-4d76-a320-607064e2f607 req-9e22ec94-d37f-4bea-975f-b396f6f16f58 tempest-ServerActionsTestOtherA-851711418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.685s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-c6f7b2a2-78fa-4d76-a320-607064e2f607 req-9e22ec94-d37f-4bea-975f-b396f6f16f58 tempest-ServerActionsTestOtherA-851711418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecdde1ab-db92-4740-96bd-1d7937cd3c51', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:32:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-c6f7b2a2-78fa-4d76-a320-607064e2f607 req-9e22ec94-d37f-4bea-975f-b396f6f16f58 tempest-ServerActionsTestOtherA-851711418 None] attachment_update completed successfully. Jul 15 18:32:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c6eacea0-845c-4c08-87fb-ef252f39bcb2 tempest-GroupSnapshotsTest-211943275 None] Update group completed successfully. Jul 15 18:32:32 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e224323e-aa76-41d4-b7b9-3f43d1e45b15 tempest-GroupSnapshotsTest-211943275 None] Update group completed successfully. Jul 15 18:32:34 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d82ad312-4982-4bea-9265-c37e0318f54e tempest-GroupSnapshotsV319Test-1915402508 None] Group tempest-GroupSnapshotsV319Test-Group-1418421978: creating Jul 15 18:32:34 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d82ad312-4982-4bea-9265-c37e0318f54e tempest-GroupSnapshotsV319Test-1915402508 None] Group tempest-GroupSnapshotsV319Test-Group-1418421978: created successfully Jul 15 18:32:34 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d82ad312-4982-4bea-9265-c37e0318f54e tempest-GroupSnapshotsV319Test-1915402508 None] Create group completed successfully. Jul 15 18:32:34 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] GroupSnapshot 7d41675e-4384-4474-a4fd-60c4d3255731: creating. Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Group snapshot 7d41675e-4384-4474-a4fd-60c4d3255731: creating. {{(pid=87863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Creating offline snapshot 3eb59b2b-3917-44ea-b429-e70049db63d8 of volume 2b0a9176-0d78-4f8f-9c9f-dd187020fc94 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d4bf39-1761-40c9-845d-e5d00a17d0b3]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:35 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:32:35 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:35 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 Jul 15 18:32:35 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:35 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.424s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:36 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" returned: 0 in 0.991s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:36 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 1G Jul 15 18:32:36 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:37 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 1G" returned: 0 in 1.297s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:37 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 Jul 15 18:32:37 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Flow 'volume_create_manager' (21ba9ca7-0752-4819-9abf-36d63416fc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4822734e-00fa-4c05-bcbb-54027b5c98e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4822734e-00fa-4c05-bcbb-54027b5c98e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1961256697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=443b61d6-206d-4a3e-ba00-7bba5607092d,host='devstack@QuobyteHD#QuobyteHD',id=4e285cd9-732f-4a11-b200-1b4e14df6931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2f11aa72cd497dbf6c39f62a016361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:37Z,use_quota=True,user_id='2a6c2c0306cc45ac851571216d3491d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(500f7702-1fa4-4911-bd55-c8addd0e2b36),volume_type_id=500f7702-1fa4-4911-bd55-c8addd0e2b36)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef66589-de22-4f5b-8ad0-f3de6c554b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef66589-de22-4f5b-8ad0-f3de6c554b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d566a98d-1552-41db-b665-5c6c501c9a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d566a98d-1552-41db-b665-5c6c501c9a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e285cd9-732f-4a11-b200-1b4e14df6931', 'volume_name': 'volume-4e285cd9-732f-4a11-b200-1b4e14df6931', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95dd3ef-dba4-47c0-847c-a9ab7ed94688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95dd3ef-dba4-47c0-847c-a9ab7ed94688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5341bf4-89ba-418f-9001-43c14861a74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Volume 4e285cd9-732f-4a11-b200-1b4e14df6931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e285cd9-732f-4a11-b200-1b4e14df6931', 'volume_size': 1} Jul 15 18:32:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:38 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8" returned: 0 in 0.657s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:38 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:32:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:38 devstack sudo[92212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 Jul 15 18:32:38 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:38 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8" returned: 0 in 0.464s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:38 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.info Jul 15 18:32:38 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:38 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.info" returned: 0 in 0.383s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:38 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:32:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:39 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.info Jul 15 18:32:39 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:39 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.info" returned: 0 in 0.275s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.248s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Creating offline snapshot bdafe2e8-2948-4cdf-ba0e-bde1bae71593 of volume 38faf774-fdee-4d51-ab35-f2cc3b5f6947 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:32:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e94bd10-d60f-403c-a9cd-d6420365e846]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:39 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 Jul 15 18:32:39 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:39 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947" returned: 0 in 0.421s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:39 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 1G Jul 15 18:32:39 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:40 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 1G" returned: 0 in 0.455s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:40 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 Jul 15 18:32:40 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:40 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593" returned: 0 in 0.349s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:40 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:32:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:40 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 Jul 15 18:32:40 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:40 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593" returned: 0 in 0.260s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:40 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.info Jul 15 18:32:40 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:41 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.info" returned: 0 in 0.324s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:41 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:41 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.info Jul 15 18:32:41 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:41 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.info" returned: 0 in 0.273s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.736s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=443b61d6-206d-4a3e-ba00-7bba5607092d,created_at=2026-07-15T16:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1961256697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=443b61d6-206d-4a3e-ba00-7bba5607092d,host='devstack@QuobyteHD#QuobyteHD',id=4e285cd9-732f-4a11-b200-1b4e14df6931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2f11aa72cd497dbf6c39f62a016361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:37Z,use_quota=True,user_id='2a6c2c0306cc45ac851571216d3491d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(500f7702-1fa4-4911-bd55-c8addd0e2b36),volume_type_id=500f7702-1fa4-4911-bd55-c8addd0e2b36)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Creating volume 4e285cd9-732f-4a11-b200-1b4e14df6931 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:32:41 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:32:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:41 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 1073741824 Jul 15 18:32:41 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:41 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bb08a2c8-664b-4341-8717-c83d95c52293 tempest-GroupSnapshotsTest-211943275 None] group_snapshot 7d41675e-4384-4474-a4fd-60c4d3255731: created successfully Jul 15 18:32:42 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 1073741824" returned: 0 in 0.541s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:42 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 Jul 15 18:32:42 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:42 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931" returned: 0 in 0.302s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5341bf4-89ba-418f-9001-43c14861a74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e285cd9-732f-4a11-b200-1b4e14df6931', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca429f0c-2cd9-433b-8f55-6d7920ffb850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:42 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Volume volume-4e285cd9-732f-4a11-b200-1b4e14df6931 (4e285cd9-732f-4a11-b200-1b4e14df6931): created successfully Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca429f0c-2cd9-433b-8f55-6d7920ffb850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Flow 'volume_create_manager' (21ba9ca7-0752-4819-9abf-36d63416fc28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:42 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-dfb94447-01ab-402f-92d7-b69c179e16d2 tempest-GroupSnapshotsV319Test-1915402508 None] Created volume successfully. Jul 15 18:32:42 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] group_snapshot 7d41675e-4384-4474-a4fd-60c4d3255731: deleting Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] group_snapshot 7d41675e-4384-4474-a4fd-60c4d3255731: deleting {{(pid=87863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-3eb59b2b-3917-44ea-b429-e70049db63d8" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-3eb59b2b-3917-44ea-b429-e70049db63d8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Deleting offline snapshot 3eb59b2b-3917-44ea-b429-e70049db63d8 of volume 2b0a9176-0d78-4f8f-9c9f-dd187020fc94 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] snapshot_file for this snap is: volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b896d411-25f6-46d6-857d-845dc7e1c158]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:43 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 Jul 15 18:32:43 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:43 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8" returned: 0 in 0.409s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5734a04e-bec0-4dcd-9ed3-21bb2a3a1ec6]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:43 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 Jul 15 18:32:43 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:43 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] GroupSnapshot d24fd39d-1cd1-4867-a179-b5c7baf56086: creating. Jul 15 18:32:43 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Group snapshot d24fd39d-1cd1-4867-a179-b5c7baf56086: creating. {{(pid=87863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" returned: 0 in 0.453s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:43 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 Jul 15 18:32:43 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Creating offline snapshot e877ef98-8c13-45dd-9d8c-1a0599906130 of volume 4e285cd9-732f-4a11-b200-1b4e14df6931 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a84d3d9-ac13-4934-8418-8485ef60b651]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:44 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 Jul 15 18:32:44 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:44 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8" returned: 0 in 0.386s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:44 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8 Jul 15 18:32:44 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:44 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931" returned: 0 in 0.432s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:44 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 1G Jul 15 18:32:44 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:44 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94.3eb59b2b-3917-44ea-b429-e70049db63d8" returned: 0 in 0.275s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-3eb59b2b-3917-44ea-b429-e70049db63d8" released by "_delete_snapshot" :: held 1.648s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" released by "delete_snapshot" :: held 1.681s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-38faf774-fdee-4d51-ab35-f2cc3b5f6947" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-38faf774-fdee-4d51-ab35-f2cc3b5f6947" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-bdafe2e8-2948-4cdf-ba0e-bde1bae71593" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-bdafe2e8-2948-4cdf-ba0e-bde1bae71593" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Deleting offline snapshot bdafe2e8-2948-4cdf-ba0e-bde1bae71593 of volume 38faf774-fdee-4d51-ab35-f2cc3b5f6947 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] snapshot_file for this snap is: volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7418f89a-ad69-4a95-a350-469d08ea818e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:44 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 Jul 15 18:32:44 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:44 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 1G" returned: 0 in 0.450s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e285cd9-732f-4a11-b200-1b4e14df6931 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:44 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e285cd9-732f-4a11-b200-1b4e14df6931 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 Jul 15 18:32:44 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:45 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593" returned: 0 in 0.382s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[867ccade-2703-4184-bd91-97eaf5a605a1]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:45 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e285cd9-732f-4a11-b200-1b4e14df6931 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130" returned: 0 in 0.348s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:45 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:45 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 Jul 15 18:32:45 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:45 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 Jul 15 18:32:45 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:45 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130" returned: 0 in 0.297s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:45 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947" returned: 0 in 0.400s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:45 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 Jul 15 18:32:45 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:45 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.info Jul 15 18:32:45 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:45 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.info" returned: 0 in 0.322s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:45 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:45 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593" returned: 0 in 0.375s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:45 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.info Jul 15 18:32:45 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:45 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593 Jul 15 18:32:45 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:46 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.info" returned: 0 in 0.292s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:46 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947.bdafe2e8-2948-4cdf-ba0e-bde1bae71593" returned: 0 in 0.305s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-bdafe2e8-2948-4cdf-ba0e-bde1bae71593" released by "_delete_snapshot" :: held 1.561s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-38faf774-fdee-4d51-ab35-f2cc3b5f6947" released by "delete_snapshot" :: held 1.598s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:46 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-80b337a0-6527-48a7-b8a0-d685662e15c8 tempest-GroupSnapshotsV319Test-1915402508 None] group_snapshot d24fd39d-1cd1-4867-a179-b5c7baf56086: created successfully Jul 15 18:32:46 devstack cinder-volume[87863]: WARNING cinder.quota [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1085724413 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1085724413, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:46 devstack cinder-volume[87863]: WARNING cinder.quota [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1085724413 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1085724413, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:46 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Created reservations ['5ea27c23-2d03-4e95-9606-48f0651b2629', '3c2edee0-11a2-49d2-9149-f6025e163390', '30bb1992-7d0c-43f4-891f-fd8bd20207f3', '6543c8cb-0600-4d2d-b17a-b9efc146c455'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:46 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] Created reservations ['4916bf8e-9587-4ca3-a184-7d8ce3985e3f', '8a71a66a-f31d-4a66-9f11-e9e328fbb2dc', 'ef11b57b-52f7-425b-bfa0-c3d135afae59', 'dba82529-fa8e-4c98-bfd7-91965d1a7e5e'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:46 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bafd1b73-efe5-49ae-9c62-2ebc22e00ad8 tempest-GroupSnapshotsTest-211943275 None] group_snapshot 7d41675e-4384-4474-a4fd-60c4d3255731: deleted successfully Jul 15 18:32:47 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] group_snapshot d24fd39d-1cd1-4867-a179-b5c7baf56086: deleting Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] group_snapshot d24fd39d-1cd1-4867-a179-b5c7baf56086: deleting {{(pid=87863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Acquiring lock "cinder-quobyte-4e285cd9-732f-4a11-b200-1b4e14df6931" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "cinder-quobyte-4e285cd9-732f-4a11-b200-1b4e14df6931" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Acquiring lock "cinder-quobyte-e877ef98-8c13-45dd-9d8c-1a0599906130" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "cinder-quobyte-e877ef98-8c13-45dd-9d8c-1a0599906130" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Deleting offline snapshot e877ef98-8c13-45dd-9d8c-1a0599906130 of volume 4e285cd9-732f-4a11-b200-1b4e14df6931 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] snapshot_file for this snap is: volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b68969-d661-4248-8d1c-c1e6056d56d7]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:47 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 Jul 15 18:32:47 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" acquired by "delete_volume" :: waited 0.037s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fc8098-85de-40de-b72b-168a86e7ba87]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:48 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 Jul 15 18:32:48 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:48 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130" returned: 0 in 0.509s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e285cd9-732f-4a11-b200-1b4e14df6931(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3579c6ea-f054-4d94-b3e3-26b78b38b482]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:48 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 Jul 15 18:32:48 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:48 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" returned: 0 in 0.514s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:48 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94 Jul 15 18:32:48 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:48 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931" returned: 0 in 0.544s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:48 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:48 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" returned: 0 in 0.323s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:48 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-2b0a9176-0d78-4f8f-9c9f-dd187020fc94" released by "delete_volume" :: held 0.926s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-38faf774-fdee-4d51-ab35-f2cc3b5f6947" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-38faf774-fdee-4d51-ab35-f2cc3b5f6947" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6477488-b602-4df6-8e11-8d491f1db672]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:49 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 Jul 15 18:32:49 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:49 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130" returned: 0 in 0.564s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:49 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130 Jul 15 18:32:49 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:49 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947" returned: 0 in 0.572s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:49 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947 Jul 15 18:32:49 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:49 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931.e877ef98-8c13-45dd-9d8c-1a0599906130" returned: 0 in 0.325s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "cinder-quobyte-e877ef98-8c13-45dd-9d8c-1a0599906130" released by "_delete_snapshot" :: held 2.081s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "cinder-quobyte-4e285cd9-732f-4a11-b200-1b4e14df6931" released by "delete_snapshot" :: held 2.128s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:49 devstack cinder-volume[87863]: WARNING cinder.quota [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-402500700 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-402500700, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:49 devstack cinder-volume[87863]: WARNING cinder.quota [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-402500700 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-402500700, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] Created reservations ['ce505ff2-2b33-4cf3-80b4-2f937c6b1429', '0b2a3b23-a1a2-4b85-8563-bf8a82b0da8e', '7d0aadcd-d623-496a-9f0c-303ff94a8baa', '6f6e52ae-6f18-42b2-a464-27784f1368ef'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:49 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-38faf774-fdee-4d51-ab35-f2cc3b5f6947" returned: 0 in 0.341s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-38faf774-fdee-4d51-ab35-f2cc3b5f6947" released by "delete_volume" :: held 1.011s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a84a677e-b932-4528-be64-20aeebb34295 tempest-GroupSnapshotsV319Test-1915402508 None] group_snapshot d24fd39d-1cd1-4867-a179-b5c7baf56086: deleted successfully Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Created reservations ['6a116809-039e-45ed-aa56-7312f652855f'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:50 devstack cinder-volume[87863]: WARNING cinder.quota [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1085724413 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1085724413, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Created reservations ['7ff903cc-7d60-4c74-b4aa-c8b0a3f0612c', '223fbc72-6b02-434e-ae67-3c8905f5ab65', '8a5bfb00-e594-4236-94f7-2f23b5b43c3b', 'e9f41038-8e08-4a6f-861d-cdd5854bf577'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Created reservations ['364b810a-cdc3-46f7-b598-c11cd3014ca9', '660ef444-6c07-4158-826b-75d9466854a3', '9973643a-2655-4530-bf46-72e400310810', 'c4c92dad-52f0-4f30-a773-742726cf6a6a'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:50 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:32:50 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:50 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.281s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:50 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2620bd0d-ec24-4442-b612-5ea0f79704c6 tempest-GroupSnapshotsTest-211943275 None] Delete group completed successfully. Jul 15 18:32:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Acquiring lock "cinder-quobyte-4e285cd9-732f-4a11-b200-1b4e14df6931" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "cinder-quobyte-4e285cd9-732f-4a11-b200-1b4e14df6931" acquired by "delete_volume" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f3b05b-fbe8-412e-9bf2-e3597c7fdc43]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:51 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 Jul 15 18:32:51 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:51 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931" returned: 0 in 0.409s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:51 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931 Jul 15 18:32:51 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:51 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1135cfa1-433b-41d0-a7fb-77066c137625 tempest-GroupSnapshotsTest-211943275 None] Group tempest-GroupSnapshotsTest-Group-882989672: creating Jul 15 18:32:52 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1135cfa1-433b-41d0-a7fb-77066c137625 tempest-GroupSnapshotsTest-211943275 None] Group tempest-GroupSnapshotsTest-Group-882989672: created successfully Jul 15 18:32:52 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1135cfa1-433b-41d0-a7fb-77066c137625 tempest-GroupSnapshotsTest-211943275 None] Create group completed successfully. Jul 15 18:32:52 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e285cd9-732f-4a11-b200-1b4e14df6931" returned: 0 in 0.275s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "cinder-quobyte-4e285cd9-732f-4a11-b200-1b4e14df6931" released by "delete_volume" :: held 0.747s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Created reservations ['ab226b0c-e5a6-4340-9c3b-2863bdf08c86'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:52 devstack cinder-volume[87863]: WARNING cinder.quota [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-402500700 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-402500700, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Created reservations ['d26b439c-fb76-4b9e-bcbc-fc9792bd2c38', '083b379b-4da5-407c-afb5-df1f3dbe90ad', '82521d23-5a3e-43e8-a071-7a3f4bddd6f1', '6f4d115f-eb27-4f53-8500-9de484216fa1'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:52 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:32:52 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:52 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.275s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:52 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:52 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-abd16aa4-db9b-4869-86c5-c3595e4de215 tempest-GroupSnapshotsV319Test-1915402508 None] Delete group completed successfully. Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Flow 'volume_create_manager' (ae71ad36-fa73-4cb4-afa3-c60eaf367a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a190b59f-fbed-4ea5-bddb-58a6901b31cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a190b59f-fbed-4ea5-bddb-58a6901b31cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2139502365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55889770-d13c-4134-81f0-9afb86eb64d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2d29e43ac34d9e96599f10c402c5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:53Z,use_quota=True,user_id='8c1100a5bab942e5bb8efa3b726c35b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748c5a3d-b61c-485c-9b9d-0a3e39af2b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748c5a3d-b61c-485c-9b9d-0a3e39af2b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b5bc30-ba76-4b8c-8124-b0a30762074a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b5bc30-ba76-4b8c-8124-b0a30762074a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55889770-d13c-4134-81f0-9afb86eb64d6', 'volume_name': 'volume-55889770-d13c-4134-81f0-9afb86eb64d6', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7a7a95-8a0f-46cc-b7b8-6a24210923b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7a7a95-8a0f-46cc-b7b8-6a24210923b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabfaa4f-e790-4a00-a594-865e0f3de331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:53 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Volume 55889770-d13c-4134-81f0-9afb86eb64d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55889770-d13c-4134-81f0-9afb86eb64d6', 'volume_size': 1} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2139502365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55889770-d13c-4134-81f0-9afb86eb64d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2d29e43ac34d9e96599f10c402c5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:53Z,use_quota=True,user_id='8c1100a5bab942e5bb8efa3b726c35b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Creating volume 55889770-d13c-4134-81f0-9afb86eb64d6 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:32:53 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:53 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6 1073741824 Jul 15 18:32:53 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Flow 'volume_create_manager' (24b5aaa7-aef5-4181-9a02-e728064dac34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73e09ee-3950-41de-b3c5-573ea2928a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73e09ee-3950-41de-b3c5-573ea2928a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-962985871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f883083a-37c7-4977-aa2d-e656d4d9fb77,host='devstack@QuobyteHD#QuobyteHD',id=d58dc27a-916a-4e0f-ac96-ca333bdf5e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c153849e9c0b4eb6a3cd07d17011f252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:54Z,use_quota=True,user_id='f25fc131c9854c29a3333bd1fd4f5ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ff4941a-4811-404b-a18b-961e5e3e98d2),volume_type_id=9ff4941a-4811-404b-a18b-961e5e3e98d2)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d22a305-5e89-45e9-a234-4994e4c975db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d22a305-5e89-45e9-a234-4994e4c975db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20475c10-7602-44a1-8d0a-9d1995a0b7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20475c10-7602-44a1-8d0a-9d1995a0b7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58dc27a-916a-4e0f-ac96-ca333bdf5e71', 'volume_name': 'volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b338a7f4-f9f1-41b2-b217-32f3295cbdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b338a7f4-f9f1-41b2-b217-32f3295cbdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331d14db-de67-47a5-8b61-dcbafede7fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:53 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Volume d58dc27a-916a-4e0f-ac96-ca333bdf5e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71', 'volume_size': 1} Jul 15 18:32:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:54 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6 1073741824" returned: 0 in 0.538s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:54 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6 Jul 15 18:32:54 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:54 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6" returned: 0 in 0.288s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f883083a-37c7-4977-aa2d-e656d4d9fb77,created_at=2026-07-15T16:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-962985871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f883083a-37c7-4977-aa2d-e656d4d9fb77,host='devstack@QuobyteHD#QuobyteHD',id=d58dc27a-916a-4e0f-ac96-ca333bdf5e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c153849e9c0b4eb6a3cd07d17011f252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:54Z,use_quota=True,user_id='f25fc131c9854c29a3333bd1fd4f5ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ff4941a-4811-404b-a18b-961e5e3e98d2),volume_type_id=9ff4941a-4811-404b-a18b-961e5e3e98d2)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Creating volume d58dc27a-916a-4e0f-ac96-ca333bdf5e71 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:32:54 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabfaa4f-e790-4a00-a594-865e0f3de331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55889770-d13c-4134-81f0-9afb86eb64d6', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:54 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 1073741824 Jul 15 18:32:54 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50051a7-609a-4acd-9033-b53eb20e2ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:54 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Volume volume-55889770-d13c-4134-81f0-9afb86eb64d6 (55889770-d13c-4134-81f0-9afb86eb64d6): created successfully Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50051a7-609a-4acd-9033-b53eb20e2ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Flow 'volume_create_manager' (ae71ad36-fa73-4cb4-afa3-c60eaf367a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-070a18f6-e734-44ef-9a25-d55c6361ebf3 tempest-AttachVolumeShelveTestJSON-24933064 None] Created volume successfully. Jul 15 18:32:55 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 1073741824" returned: 0 in 0.531s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:55 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 Jul 15 18:32:55 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:55 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" returned: 0 in 0.289s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:32:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331d14db-de67-47a5-8b61-dcbafede7fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddcdd54-c197-420d-8090-61923ee00eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:55 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Volume volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 (d58dc27a-916a-4e0f-ac96-ca333bdf5e71): created successfully Jul 15 18:32:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddcdd54-c197-420d-8090-61923ee00eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Flow 'volume_create_manager' (24b5aaa7-aef5-4181-9a02-e728064dac34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:55 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ececd402-1c33-4559-a7ff-bbd5e5dc3c60 tempest-GroupSnapshotsTest-211943275 None] Created volume successfully. Jul 15 18:32:56 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] GroupSnapshot 03d83f99-be07-48d0-8645-24d8753d3206: creating. Jul 15 18:32:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Group snapshot 03d83f99-be07-48d0-8645-24d8753d3206: creating. {{(pid=87863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 15 18:32:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Creating offline snapshot 9a8819b8-20cc-4656-8fb5-513e26ad52ba of volume d58dc27a-916a-4e0f-ac96-ca333bdf5e71 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:32:56 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b3f7f6-0a3b-4844-8c18-231a16284f8d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:56 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 Jul 15 18:32:56 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:56 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" returned: 0 in 0.451s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:56 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba 1G Jul 15 18:32:56 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:57 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba 1G" returned: 0 in 0.727s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:57 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba Jul 15 18:32:57 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:58 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba" returned: 0 in 0.404s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:58 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:32:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:58 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba Jul 15 18:32:58 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:58 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba" returned: 0 in 0.372s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:58 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.info Jul 15 18:32:58 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:58 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.info" returned: 0 in 0.349s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:58 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:32:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:58 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.info Jul 15 18:32:58 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:59 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.info" returned: 0 in 0.437s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.858s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-69b639bb-0787-4e21-83c2-839e9a58e3e1 tempest-GroupSnapshotsTest-211943275 None] group_snapshot 03d83f99-be07-48d0-8645-24d8753d3206: created successfully Jul 15 18:32:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] group_snapshot 03d83f99-be07-48d0-8645-24d8753d3206: deleting Jul 15 18:32:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] group_snapshot 03d83f99-be07-48d0-8645-24d8753d3206: deleting {{(pid=87863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 15 18:32:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-9a8819b8-20cc-4656-8fb5-513e26ad52ba" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-9a8819b8-20cc-4656-8fb5-513e26ad52ba" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Deleting offline snapshot 9a8819b8-20cc-4656-8fb5-513e26ad52ba of volume d58dc27a-916a-4e0f-ac96-ca333bdf5e71 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:33:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] snapshot_file for this snap is: volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:33:00 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[726e3a78-f2cd-4b88-b1c4-2671046c3b04]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:00 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba Jul 15 18:33:00 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:00 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba" returned: 0 in 0.575s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:33:00 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a9ca48-84a0-487a-aeab-fb88174f9812]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:00 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 Jul 15 18:33:00 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:01 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" returned: 0 in 0.708s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:01 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba Jul 15 18:33:01 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:01 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-ac84d3bf-1926-4cbf-b18f-be581d2be48e req-200035ca-c35d-4ad5-bc7d-b43a3b706a8d tempest-ServerActionsTestOtherA-851711418 None] Terminate volume connection completed successfully. Jul 15 18:33:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-ac84d3bf-1926-4cbf-b18f-be581d2be48e req-200035ca-c35d-4ad5-bc7d-b43a3b706a8d tempest-ServerActionsTestOtherA-851711418 None] Deleting attachment ecdde1ab-db92-4740-96bd-1d7937cd3c51. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:33:01 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba" returned: 0 in 0.442s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:01 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba Jul 15 18:33:01 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:02 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71.9a8819b8-20cc-4656-8fb5-513e26ad52ba" returned: 0 in 0.344s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-9a8819b8-20cc-4656-8fb5-513e26ad52ba" released by "_delete_snapshot" :: held 2.240s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" released by "delete_snapshot" :: held 2.287s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:02 devstack cinder-volume[87863]: WARNING cinder.quota [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-338592327 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-338592327, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:02 devstack cinder-volume[87863]: WARNING cinder.quota [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-338592327 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-338592327, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:02 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] Created reservations ['c06e8817-913b-42ed-b3e7-970f391c47c6', 'c905a16e-a6ad-4a85-a0c0-1bce9553bf53', '863ebb02-3a04-45c1-bd6a-c62171bd306b', 'ce8c7191-50fd-4535-aeac-5cbc7ce54996'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:02 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ab91c7ca-ed9d-4840-bcb0-433877767543 tempest-GroupSnapshotsTest-211943275 None] group_snapshot 03d83f99-be07-48d0-8645-24d8753d3206: deleted successfully Jul 15 18:33:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "cinder-quobyte-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:04 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3476a92-b834-4b3f-ad85-3e9d53bb780c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:04 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 Jul 15 18:33:04 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:04 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" returned: 0 in 0.582s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:04 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71 Jul 15 18:33:04 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:05 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" returned: 0 in 0.361s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Lock "cinder-quobyte-d58dc27a-916a-4e0f-ac96-ca333bdf5e71" released by "delete_volume" :: held 1.046s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:05 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Created reservations ['d96c62f8-abb7-4ffe-8122-815c0c93b2f7'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:05 devstack cinder-volume[87863]: WARNING cinder.quota [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-338592327 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-338592327, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:05 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Created reservations ['16636e4d-a0bc-4b7b-b084-f7d824666b4e', '9c4438ab-ddc8-490a-8fa0-05d713adcafc', '7f85bb90-f050-4845-9a05-14ad158c35f2', '5446cf7c-21e0-4dc5-9a5e-3e0a7d01fb09'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:05 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:33:05 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:06 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.520s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:06 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2ccd36a1-bf51-4a43-bce9-f52ba7ce7e57 tempest-GroupSnapshotsTest-211943275 None] Delete group completed successfully. Jul 15 18:33:08 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=124,cinder:SELECT=142,cinder:INSERT=23,cinder:DELETE=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:33:08 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=129,cinder:SELECT=133,cinder:INSERT=35,cinder:DELETE=4 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:33:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-fecb2c5e-23d9-4545-8464-9428139f23f5 req-519d5b9e-941d-47af-91bf-16f5fb667503 tempest-AttachVolumeShelveTestJSON-24933064 None] No connector for attachment 1e70e56b-1599-4a02-8d3e-eac501bd557f; skipping storage backend terminate_connection call. {{(pid=87863) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 15 18:33:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-fecb2c5e-23d9-4545-8464-9428139f23f5 req-519d5b9e-941d-47af-91bf-16f5fb667503 tempest-AttachVolumeShelveTestJSON-24933064 None] Deleting attachment 1e70e56b-1599-4a02-8d3e-eac501bd557f. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:33:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Acquiring lock "cinder-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Lock "cinder-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Acquiring lock "cinder-quobyte-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Lock "cinder-quobyte-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a" acquired by "delete_volume" :: waited 0.056s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa65b5bf-f36c-460b-934b-03d95ca2ca4e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:09 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a Jul 15 18:33:09 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:09 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a" returned: 0 in 0.543s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:09 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a Jul 15 18:33:09 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:10 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a" returned: 0 in 0.336s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Lock "cinder-quobyte-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a" released by "delete_volume" :: held 0.961s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Created reservations ['2f486a1a-8d08-4d7d-a359-d16cb6b12cbc', '9d25fdd8-b017-412d-a267-93ca380e7814', '85c1138b-cb56-4e43-8164-63e5a480fff4', '477d59c8-c7a8-46b6-a865-fbc25a43349b'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:10 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:33:10 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:10 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.296s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:10 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Deleted volume successfully. Jul 15 18:33:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f39d252f-3d01-405e-8cce-0389f0ed56e4 tempest-ServerActionsTestOtherA-851711418 None] Lock "cinder-02dc57a9-8d78-478c-b1d6-c3f3c2b9b40a-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:20 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:33:20 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:33:33 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:33:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Flow 'volume_create_manager' (3aba7ba6-9e26-4741-a39d-5156150d035f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e73f53e-21a3-4c34-9858-b3960a423198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e73f53e-21a3-4c34-9858-b3960a423198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2115605197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbf8e41-7974-430b-81be-1dba2c4c8557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e2e6082ce46dc9be27f002fde3f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:34Z,use_quota=True,user_id='8011656acc6f45cdb7621c0734fe399e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab06ecf8-fba7-40ab-aa97-dc1c9a7c36c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab06ecf8-fba7-40ab-aa97-dc1c9a7c36c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864ff624-6b2f-42f0-a55b-66460e6f5d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:33 devstack cinder-volume[87863]: DEBUG cinder.image.glance [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Creating Keystone auth plugin from conf {{(pid=87863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:35 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:33:35 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864ff624-6b2f-42f0-a55b-66460e6f5d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dcbf8e41-7974-430b-81be-1dba2c4c8557', 'volume_name': 'volume-dcbf8e41-7974-430b-81be-1dba2c4c8557', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f11240a-eb68-49e3-bf9d-cd4b8d4f4631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f11240a-eb68-49e3-bf9d-cd4b8d4f4631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce9c7fa-4207-4c8e-9c83-047fed11f18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:35 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Volume dcbf8e41-7974-430b-81be-1dba2c4c8557: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dcbf8e41-7974-430b-81be-1dba2c4c8557', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Trying to clone dcbf8e41-7974-430b-81be-1dba2c4c8557 from image 26627af3-14a2-4924-a235-ca96adb6f0af at location (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]). {{(pid=87863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:33:35 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.471s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:33:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:33:36 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:33:36 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Image download 20.69 MB at 20.69 MB/s Jul 15 18:33:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c674503-d815-4a3e-88b0-a4a21eab4c07]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:36 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD Jul 15 18:33:36 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:36 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:36 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Temporary image 26627af3-14a2-4924-a235-ca96adb6f0af is fetched for user 8011656acc6f45cdb7621c0734fe399e. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:33:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c14edc9-4f26-4b9d-a26b-2218e5278551]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:36 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD Jul 15 18:33:36 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:37 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2115605197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbf8e41-7974-430b-81be-1dba2c4c8557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8e2e6082ce46dc9be27f002fde3f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:34Z,use_quota=True,user_id='8011656acc6f45cdb7621c0734fe399e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Creating volume dcbf8e41-7974-430b-81be-1dba2c4c8557 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:33:37 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:37 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 1073741824 Jul 15 18:33:37 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:37 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 1073741824" returned: 0 in 0.579s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:37 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 Jul 15 18:33:37 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:38 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557" returned: 0 in 0.370s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Attempting download of 26627af3-14a2-4924-a235-ca96adb6f0af ((None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}])) to volume dcbf8e41-7974-430b-81be-1dba2c4c8557. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Flow 'volume_create_manager' (a565a5c6-0efe-46f0-a486-e1ee7237abd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa9757c-8d28-41a2-adea-8be9700897ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5f9094-02f8-4adb-9289-96a607e6d167]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af__jyge6lw {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa9757c-8d28-41a2-adea-8be9700897ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1657188806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6514b83a-b93c-4711-a9d9-eab47c5a81c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8996cfc19d7042758875ec5714cb7b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:38Z,use_quota=True,user_id='fa616c54ef4343109412c59ee1723877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463e9924-21c9-48b0-a975-e2011aa62730),volume_type_id=463e9924-21c9-48b0-a975-e2011aa62730)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0403bd-f167-4316-9077-584e060d7b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0403bd-f167-4316-9077-584e060d7b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd72d6cc-ad3d-4b8f-8689-e04a403a8338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd72d6cc-ad3d-4b8f-8689-e04a403a8338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6514b83a-b93c-4711-a9d9-eab47c5a81c9', 'volume_name': 'volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf0b675-7e7b-43a0-a265-14fe85e63fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf0b675-7e7b-43a0-a265-14fe85e63fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1587b95f-37f5-4baa-82ae-cc88e2f7aa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:38 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Volume 6514b83a-b93c-4711-a9d9-eab47c5a81c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9', 'volume_size': 1} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1657188806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6514b83a-b93c-4711-a9d9-eab47c5a81c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8996cfc19d7042758875ec5714cb7b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:38Z,use_quota=True,user_id='fa616c54ef4343109412c59ee1723877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463e9924-21c9-48b0-a975-e2011aa62730),volume_type_id=463e9924-21c9-48b0-a975-e2011aa62730)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Creating volume 6514b83a-b93c-4711-a9d9-eab47c5a81c9 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:33:38 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:38 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9 1073741824 Jul 15 18:33:38 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:38 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af__jyge6lw Jul 15 18:33:38 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:38 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af__jyge6lw" returned: 0 in 0.380s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af__jyge6lw {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:38 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af__jyge6lw Jul 15 18:33:38 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:38 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9 1073741824" returned: 0 in 0.653s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:39 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9 Jul 15 18:33:39 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:39 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af__jyge6lw" returned: 1 in 0.506s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af__jyge6lw' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[92140d6b-c8b1-45e0-9603-5226eeb4aaf2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:39 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD Jul 15 18:33:39 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:39 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9" returned: 0 in 0.317s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1587b95f-37f5-4baa-82ae-cc88e2f7aa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d14e722-323f-410c-91f2-98cd89a4b0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:39 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Volume volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9 (6514b83a-b93c-4711-a9d9-eab47c5a81c9): created successfully Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d14e722-323f-410c-91f2-98cd89a4b0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Flow 'volume_create_manager' (a565a5c6-0efe-46f0-a486-e1ee7237abd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:39 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-aa578cb8-66f6-43d3-b184-289408c25cf8 tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Created volume successfully. Jul 15 18:33:39 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] 26627af3-14a2-4924-a235-ca96adb6f0af was qcow2, converting to raw {{(pid=87863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:33:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:39 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 Jul 15 18:33:39 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-16bd31e1-d84a-458c-8549-13702362728b tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-16bd31e1-d84a-458c-8549-13702362728b tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-16bd31e1-d84a-458c-8549-13702362728b tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-16bd31e1-d84a-458c-8549-13702362728b tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-16bd31e1-d84a-458c-8549-13702362728b tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-16bd31e1-d84a-458c-8549-13702362728b tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:40 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:33:40 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:40 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-16bd31e1-d84a-458c-8549-13702362728b tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.303s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:41 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-16bd31e1-d84a-458c-8549-13702362728b tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:41 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-16bd31e1-d84a-458c-8549-13702362728b tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Retype volume completed successfully. Jul 15 18:33:41 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557" returned: 0 in 1.761s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:41 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_2fcsr8l3devstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:33:41 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Converted 112.00 MB image at 63.56 MB/s Jul 15 18:33:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:41 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 1G Jul 15 18:33:41 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:41 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 1G" returned: 0 in 0.318s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:41 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[761d0e7d-768e-4146-b6b0-00519f03e9bd]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:41 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 Jul 15 18:33:41 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Acquiring lock "cinder-6514b83a-b93c-4711-a9d9-eab47c5a81c9-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "cinder-6514b83a-b93c-4711-a9d9-eab47c5a81c9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Acquiring lock "cinder-quobyte-6514b83a-b93c-4711-a9d9-eab47c5a81c9" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "cinder-quobyte-6514b83a-b93c-4711-a9d9-eab47c5a81c9" acquired by "delete_volume" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:42 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557" returned: 0 in 0.415s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e744b6-76b7-4914-b09c-dbf03696d9dc]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:42 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 Jul 15 18:33:42 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:42 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9 Jul 15 18:33:42 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:42 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557" returned: 1 in 0.498s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Downloaded image 26627af3-14a2-4924-a235-ca96adb6f0af ((None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}])) to volume dcbf8e41-7974-430b-81be-1dba2c4c8557 successfully. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Temporary image 26627af3-14a2-4924-a235-ca96adb6f0af for user 8011656acc6f45cdb7621c0734fe399e is deleted. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Marking volume dcbf8e41-7974-430b-81be-1dba2c4c8557 as bootable. {{(pid=87863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Copying metadata from image 26627af3-14a2-4924-a235-ca96adb6f0af to dcbf8e41-7974-430b-81be-1dba2c4c8557. {{(pid=87863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Creating volume glance metadata for volume dcbf8e41-7974-430b-81be-1dba2c4c8557 backed by image 26627af3-14a2-4924-a235-ca96adb6f0af with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:33:42 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9" returned: 0 in 0.595s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:42 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9 Jul 15 18:33:42 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce9c7fa-4207-4c8e-9c83-047fed11f18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcbf8e41-7974-430b-81be-1dba2c4c8557', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cddc66-e4fb-46cb-9efa-3c58306de8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:42 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Volume volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 (dcbf8e41-7974-430b-81be-1dba2c4c8557): created successfully Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cddc66-e4fb-46cb-9efa-3c58306de8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Flow 'volume_create_manager' (3aba7ba6-9e26-4741-a39d-5156150d035f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:42 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9e7a3ec6-f9c9-4219-b35a-bede679f0fd3 tempest-VolumesImageMetadata-1488983427 None] Created volume successfully. Jul 15 18:33:43 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6514b83a-b93c-4711-a9d9-eab47c5a81c9" returned: 0 in 0.358s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "cinder-quobyte-6514b83a-b93c-4711-a9d9-eab47c5a81c9" released by "delete_volume" :: held 1.025s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:43 devstack cinder-volume[87863]: WARNING cinder.quota [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:43 devstack cinder-volume[87863]: WARNING cinder.quota [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Created reservations ['3db83331-ffd2-435a-b760-e8f138f69dfc', 'f4f41651-d6cf-44ba-8f50-5982a88753ca', '119864ac-cb56-4709-a2ca-50de6ba0e7ab', '10cdd2e4-e3c5-46a6-9518-5d8724aaf178'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:43 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:33:43 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:43 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.340s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:43 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Deleted volume successfully. Jul 15 18:33:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8fbea03e-2623-4d37-97e2-2eba173f5b9d tempest-VolumeRetypeWithoutMigrationTest-1087244552 None] Lock "cinder-6514b83a-b93c-4711-a9d9-eab47c5a81c9-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Acquiring lock "cinder-dcbf8e41-7974-430b-81be-1dba2c4c8557-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Lock "cinder-dcbf8e41-7974-430b-81be-1dba2c4c8557-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Acquiring lock "cinder-quobyte-dcbf8e41-7974-430b-81be-1dba2c4c8557" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Lock "cinder-quobyte-dcbf8e41-7974-430b-81be-1dba2c4c8557" acquired by "delete_volume" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:44 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6097fe1-4b3b-43f9-a750-51387c5e3e8c]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:44 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 Jul 15 18:33:44 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:44 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557" returned: 0 in 0.425s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:44 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 Jul 15 18:33:44 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:45 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557" returned: 1 in 0.466s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:45 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557 Jul 15 18:33:45 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:45 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dcbf8e41-7974-430b-81be-1dba2c4c8557" returned: 0 in 0.383s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Lock "cinder-quobyte-dcbf8e41-7974-430b-81be-1dba2c4c8557" released by "delete_volume" :: held 1.373s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Created reservations ['34be4923-0e25-45c5-9da0-37e77451dd9d', '1add9fc0-f4a4-407b-bb19-7225df79b70a', '5a4b85f0-d356-474b-87fd-c211da5eef1a', '82b80e3a-4b36-49e9-a654-02500ad5e768'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:45 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:33:45 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:46 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.457s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:46 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:46 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Deleted volume successfully. Jul 15 18:33:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8ccbc122-2558-41cf-82bf-b3ac14f924b9 tempest-VolumesImageMetadata-1488983427 None] Lock "cinder-dcbf8e41-7974-430b-81be-1dba2c4c8557-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Acquiring lock "cinder-55889770-d13c-4134-81f0-9afb86eb64d6-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Lock "cinder-55889770-d13c-4134-81f0-9afb86eb64d6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Acquiring lock "cinder-quobyte-55889770-d13c-4134-81f0-9afb86eb64d6" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Lock "cinder-quobyte-55889770-d13c-4134-81f0-9afb86eb64d6" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be2f584-bfc3-413f-9fae-d79d081ea02d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:52 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6 Jul 15 18:33:52 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:52 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6" returned: 0 in 0.708s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:52 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6 Jul 15 18:33:52 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:53 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-55889770-d13c-4134-81f0-9afb86eb64d6" returned: 0 in 0.594s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Lock "cinder-quobyte-55889770-d13c-4134-81f0-9afb86eb64d6" released by "delete_volume" :: held 1.398s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:53 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Created reservations ['9360b8c1-e74c-4789-9b39-2a16799d53e2', '2754a573-6543-430c-bb1b-4c6e56295a94', '3fa7abc5-6ab5-4e9c-ba22-b1d3e12ded4d', '63187b22-9d08-4eec-88f2-a9e09505ecc9'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:53 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:33:53 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:54 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.499s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:54 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Deleted volume successfully. Jul 15 18:33:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b125383c-675e-4bb1-ac73-aa2b3d28c7eb tempest-AttachVolumeShelveTestJSON-24933064 None] Lock "cinder-55889770-d13c-4134-81f0-9afb86eb64d6-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:56 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:33:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Flow 'volume_create_manager' (558fa14d-b7e6-4509-9d60-faa1559a3b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5cf143e-09b7-41e9-84dd-adebb2165ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:56 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:33:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Flow 'volume_create_manager' (956b64ff-78e1-4a6e-8a36-064a1484052c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a303627-a98c-4004-869e-f3d418311aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5cf143e-09b7-41e9-84dd-adebb2165ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1925532889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23bacec5-7c8c-4f48-9e1c-1c3e77480698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d3e07dc4f14f3cae500de32ce13e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:57Z,use_quota=True,user_id='75b223358fd4424bbe387caaf1523bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2628b502-3e5d-4475-a5fb-ae440fdf7931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2628b502-3e5d-4475-a5fb-ae440fdf7931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3e3a6d-f8f7-4964-b33b-80a62a0cd7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3e3a6d-f8f7-4964-b33b-80a62a0cd7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23bacec5-7c8c-4f48-9e1c-1c3e77480698', 'volume_name': 'volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83132d9c-e321-4ea5-96a1-f48437a1b314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83132d9c-e321-4ea5-96a1-f48437a1b314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f43c89-f452-4858-bf17-9745c99aefb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:57 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Volume 23bacec5-7c8c-4f48-9e1c-1c3e77480698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698', 'volume_size': 1} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1925532889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23bacec5-7c8c-4f48-9e1c-1c3e77480698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d3e07dc4f14f3cae500de32ce13e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:57Z,use_quota=True,user_id='75b223358fd4424bbe387caaf1523bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Creating volume 23bacec5-7c8c-4f48-9e1c-1c3e77480698 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:33:57 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:57 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698 1073741824 Jul 15 18:33:57 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a303627-a98c-4004-869e-f3d418311aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-398693678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80becf04-91fd-48e9-a1e8-a428a25f66dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af5f1c7c8241d2b8e091c753656a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:57Z,use_quota=True,user_id='e26b3bcaacaf45c1abc8d538c9b9d97f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d637c0-2ea1-4393-8f15-96e604e65a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d637c0-2ea1-4393-8f15-96e604e65a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72553481-1855-407f-93eb-c51595010404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72553481-1855-407f-93eb-c51595010404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80becf04-91fd-48e9-a1e8-a428a25f66dc', 'volume_name': 'volume-80becf04-91fd-48e9-a1e8-a428a25f66dc', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1179071-2c8a-490d-bec0-764cb12fdcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1179071-2c8a-490d-bec0-764cb12fdcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ea9438-c700-449d-a604-7dd67304f2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:57 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Volume 80becf04-91fd-48e9-a1e8-a428a25f66dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80becf04-91fd-48e9-a1e8-a428a25f66dc', 'volume_size': 1} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:57 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698 1073741824" returned: 0 in 0.751s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:57 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698 Jul 15 18:33:57 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:58 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698" returned: 0 in 0.342s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-398693678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80becf04-91fd-48e9-a1e8-a428a25f66dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af5f1c7c8241d2b8e091c753656a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:57Z,use_quota=True,user_id='e26b3bcaacaf45c1abc8d538c9b9d97f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Creating volume 80becf04-91fd-48e9-a1e8-a428a25f66dc {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:33:58 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f43c89-f452-4858-bf17-9745c99aefb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b0f05d-ac4d-4ccb-b8f5-7e6084ee626f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:58 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc 1073741824 Jul 15 18:33:58 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:58 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Volume volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698 (23bacec5-7c8c-4f48-9e1c-1c3e77480698): created successfully Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b0f05d-ac4d-4ccb-b8f5-7e6084ee626f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Flow 'volume_create_manager' (558fa14d-b7e6-4509-9d60-faa1559a3b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:58 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9e3256d1-2e23-4dfd-8a50-c3a50d74d515 tempest-VolumesTransfersTest-1828681205 None] Created volume successfully. Jul 15 18:33:59 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc 1073741824" returned: 0 in 0.993s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:59 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc Jul 15 18:33:59 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:59 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc" returned: 0 in 0.655s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:33:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ea9438-c700-449d-a604-7dd67304f2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80becf04-91fd-48e9-a1e8-a428a25f66dc', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45057f0-3a2e-4f40-add4-cf5ce4345c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:00 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Volume volume-80becf04-91fd-48e9-a1e8-a428a25f66dc (80becf04-91fd-48e9-a1e8-a428a25f66dc): created successfully Jul 15 18:34:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45057f0-3a2e-4f40-add4-cf5ce4345c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Flow 'volume_create_manager' (956b64ff-78e1-4a6e-8a36-064a1484052c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bcce0a72-6177-4c6d-9f59-b7e32704ef07 tempest-VolumesServicesTestJSON-1718965868 None] Created volume successfully. Jul 15 18:34:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8794f5b8-4d48-4aa1-a29c-901f69d96f54 tempest-VolumesTransfersTest-1196536387 None] Transfer volume completed successfully. Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Acquiring lock "cinder-23bacec5-7c8c-4f48-9e1c-1c3e77480698-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Lock "cinder-23bacec5-7c8c-4f48-9e1c-1c3e77480698-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Acquiring lock "cinder-quobyte-23bacec5-7c8c-4f48-9e1c-1c3e77480698" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Lock "cinder-quobyte-23bacec5-7c8c-4f48-9e1c-1c3e77480698" acquired by "delete_volume" :: waited 0.033s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c1001a-12db-43cd-af7b-79c09cb62550]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Acquiring lock "cinder-80becf04-91fd-48e9-a1e8-a428a25f66dc-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Lock "cinder-80becf04-91fd-48e9-a1e8-a428a25f66dc-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Acquiring lock "cinder-quobyte-80becf04-91fd-48e9-a1e8-a428a25f66dc" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Lock "cinder-quobyte-80becf04-91fd-48e9-a1e8-a428a25f66dc" acquired by "delete_volume" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:01 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698 Jul 15 18:34:01 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08c6ad7-8cca-427e-9163-5beee1079243]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:01 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc Jul 15 18:34:01 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:02 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698" returned: 0 in 0.841s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:02 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698 Jul 15 18:34:02 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:02 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc" returned: 0 in 0.895s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:02 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc Jul 15 18:34:02 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:02 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-23bacec5-7c8c-4f48-9e1c-1c3e77480698" returned: 0 in 0.465s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Lock "cinder-quobyte-23bacec5-7c8c-4f48-9e1c-1c3e77480698" released by "delete_volume" :: held 1.393s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Created reservations ['f9154562-6931-4f57-a7e6-d5c076639dd7', '53931488-e7f9-4fa1-a8e4-086daa10314f', 'c4ae0db6-4ce6-4fc3-8088-51de927d77fb', '5b781ba0-c550-41b2-8ba2-d870be53c2ff'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:02 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:34:02 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:03 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80becf04-91fd-48e9-a1e8-a428a25f66dc" returned: 0 in 0.471s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Lock "cinder-quobyte-80becf04-91fd-48e9-a1e8-a428a25f66dc" released by "delete_volume" :: held 1.455s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Created reservations ['387d13c3-5e0f-41ec-8f17-254e5f6ccb5a', '04db4fd1-2500-4766-a869-bcb0269cb746', '4e9fa94f-ca53-4ba2-b8bc-784c214ba7ea', 'c4297aaf-1695-4b29-873b-eb261ecbd58d'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:03 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.480s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:03 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Deleted volume successfully. Jul 15 18:34:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17502212-f7e2-4cea-9f2a-69dae0bfdfac tempest-VolumesTransfersTest-2065342040 None] Lock "cinder-23bacec5-7c8c-4f48-9e1c-1c3e77480698-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:03 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:34:03 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:04 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.607s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:04 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Deleted volume successfully. Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-16e14fd7-6867-4465-96c3-eafe2a99be83 tempest-VolumesServicesTestJSON-1718965868 None] Lock "cinder-80becf04-91fd-48e9-a1e8-a428a25f66dc-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Flow 'volume_create_manager' (c176cf38-747d-42e3-ac2f-73665b619ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d4a0c3-4c4e-4baf-945e-84b3ea2e8377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d4a0c3-4c4e-4baf-945e-84b3ea2e8377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-776259537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb83b9c2-8b09-4ead-a960-5196e178484a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d3e07dc4f14f3cae500de32ce13e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:05Z,use_quota=True,user_id='75b223358fd4424bbe387caaf1523bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233c9f6f-8695-4fd1-a38e-7f2b5586990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233c9f6f-8695-4fd1-a38e-7f2b5586990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d0e44c-d400-47c0-a321-456a66a6e1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d0e44c-d400-47c0-a321-456a66a6e1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb83b9c2-8b09-4ead-a960-5196e178484a', 'volume_name': 'volume-eb83b9c2-8b09-4ead-a960-5196e178484a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9f8a06-b3a4-4fa8-a69d-4feb1459b7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9f8a06-b3a4-4fa8-a69d-4feb1459b7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d39fe3-0d2b-41e6-abab-236cc62c636a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:04 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Volume eb83b9c2-8b09-4ead-a960-5196e178484a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb83b9c2-8b09-4ead-a960-5196e178484a', 'volume_size': 1} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-776259537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb83b9c2-8b09-4ead-a960-5196e178484a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d3e07dc4f14f3cae500de32ce13e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:05Z,use_quota=True,user_id='75b223358fd4424bbe387caaf1523bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Creating volume eb83b9c2-8b09-4ead-a960-5196e178484a {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:04 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:34:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:04 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a 1073741824 Jul 15 18:34:04 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:05 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a 1073741824" returned: 0 in 0.751s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:05 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a Jul 15 18:34:05 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:06 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a" returned: 0 in 0.529s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:34:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d39fe3-0d2b-41e6-abab-236cc62c636a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb83b9c2-8b09-4ead-a960-5196e178484a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece54495-20c6-4315-82dc-287cec9bd168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:06 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Volume volume-eb83b9c2-8b09-4ead-a960-5196e178484a (eb83b9c2-8b09-4ead-a960-5196e178484a): created successfully Jul 15 18:34:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece54495-20c6-4315-82dc-287cec9bd168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Flow 'volume_create_manager' (c176cf38-747d-42e3-ac2f-73665b619ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-cae7bb09-b330-47fb-a29f-95af2c625d7f tempest-VolumesTransfersTest-1828681205 None] Created volume successfully. Jul 15 18:34:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Acquiring lock "cinder-eb83b9c2-8b09-4ead-a960-5196e178484a-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Lock "cinder-eb83b9c2-8b09-4ead-a960-5196e178484a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Acquiring lock "cinder-quobyte-eb83b9c2-8b09-4ead-a960-5196e178484a" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Lock "cinder-quobyte-eb83b9c2-8b09-4ead-a960-5196e178484a" acquired by "delete_volume" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2946b3e3-29a4-446d-ad9d-5d8f9f44c431]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:08 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a Jul 15 18:34:08 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:08 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a" returned: 0 in 1.011s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:08 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a Jul 15 18:34:08 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:09 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-eb83b9c2-8b09-4ead-a960-5196e178484a" returned: 0 in 0.496s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Lock "cinder-quobyte-eb83b9c2-8b09-4ead-a960-5196e178484a" released by "delete_volume" :: held 1.599s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:09 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Created reservations ['d23c2ae6-3bef-48bb-a2e5-b31dde8775d3', '79950e68-579f-4d45-940d-7be8df4bf6f7', 'f047b877-331f-421d-8811-c2cbecf89c04', 'dcadb180-6674-4415-a757-05a165a8c844'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:09 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:34:09 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:10 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.566s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:10 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:10 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Deleted volume successfully. Jul 15 18:34:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-529cf8af-2ec8-49f9-8418-c541416d0f7c tempest-VolumesTransfersTest-2065342040 None] Lock "cinder-eb83b9c2-8b09-4ead-a960-5196e178484a-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Flow 'volume_create_manager' (7229059b-0ad9-469a-8b03-46273ac554b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da23a50-144c-4ef2-9e42-979a67e6d836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da23a50-144c-4ef2-9e42-979a67e6d836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1855047661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4964260-4a4b-47a0-8b69-d1626c631018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84172b6d060f44ff8d7e749f25a2c5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:19Z,use_quota=True,user_id='e12300d90b644d0fbb989d24e7a15bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd76bae5-48d1-47e7-9f33-6deb0fe83139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd76bae5-48d1-47e7-9f33-6deb0fe83139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c820a74-7c67-4a46-ac48-8c0ce140b46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c820a74-7c67-4a46-ac48-8c0ce140b46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4964260-4a4b-47a0-8b69-d1626c631018', 'volume_name': 'volume-a4964260-4a4b-47a0-8b69-d1626c631018', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bace10d-c9d2-418b-9c29-2bbea63b423b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bace10d-c9d2-418b-9c29-2bbea63b423b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082874ec-d12e-4afa-a7ad-eceb8b7ec3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:19 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Volume a4964260-4a4b-47a0-8b69-d1626c631018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4964260-4a4b-47a0-8b69-d1626c631018', 'volume_size': 1} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1855047661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4964260-4a4b-47a0-8b69-d1626c631018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84172b6d060f44ff8d7e749f25a2c5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:19Z,use_quota=True,user_id='e12300d90b644d0fbb989d24e7a15bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Creating volume a4964260-4a4b-47a0-8b69-d1626c631018 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:19 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:34:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:19 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018 1073741824 Jul 15 18:34:19 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:20 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018 1073741824" returned: 0 in 0.651s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:20 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018 Jul 15 18:34:20 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:20 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018" returned: 0 in 0.376s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:34:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082874ec-d12e-4afa-a7ad-eceb8b7ec3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4964260-4a4b-47a0-8b69-d1626c631018', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3a16f7-a06c-490b-bf70-2e81bb2e1d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:20 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Volume volume-a4964260-4a4b-47a0-8b69-d1626c631018 (a4964260-4a4b-47a0-8b69-d1626c631018): created successfully Jul 15 18:34:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3a16f7-a06c-490b-bf70-2e81bb2e1d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Flow 'volume_create_manager' (7229059b-0ad9-469a-8b03-46273ac554b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-da2e6637-4d57-41c6-a77c-8778247a0f31 tempest-ServersNegativeTestJSON-1075834468 None] Created volume successfully. Jul 15 18:34:20 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Flow 'volume_create_manager' (330abd5b-11c4-4a09-a81e-3046529529d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c538f37-6df7-4b8e-8033-af2af9aba3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c538f37-6df7-4b8e-8033-af2af9aba3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1205903937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf4ca95-f1e9-4108-b516-726c5c5d7e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3649cb0c747f4d2b8218893336ff1358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:21Z,use_quota=True,user_id='46048fd3211041aab61af563a5c3b69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b08597-f104-4c8c-867b-b481de441e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b08597-f104-4c8c-867b-b481de441e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3b9555-3a53-4bef-97c2-3ec69dd9ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3b9555-3a53-4bef-97c2-3ec69dd9ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf4ca95-f1e9-4108-b516-726c5c5d7e05', 'volume_name': 'volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05', 'volume_size': 2}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7f99c4-598d-4227-b606-379cc0d4d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7f99c4-598d-4227-b606-379cc0d4d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de0280c-ac61-4461-be3a-2d9e4f1869d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Volume fcf4ca95-f1e9-4108-b516-726c5c5d7e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05', 'volume_size': 2} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1205903937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf4ca95-f1e9-4108-b516-726c5c5d7e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3649cb0c747f4d2b8218893336ff1358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:21Z,use_quota=True,user_id='46048fd3211041aab61af563a5c3b69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Creating volume fcf4ca95-f1e9-4108-b516-726c5c5d7e05 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:21 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:34:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05 2147483648 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:21 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05 2147483648 Jul 15 18:34:21 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:22 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05 2147483648" returned: 0 in 0.973s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:22 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05 Jul 15 18:34:22 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:22 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05" returned: 0 in 0.321s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:34:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de0280c-ac61-4461-be3a-2d9e4f1869d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05', 'volume_size': 2}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c3506e-40f2-48c5-9f42-07c01f92952c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:22 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Volume volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05 (fcf4ca95-f1e9-4108-b516-726c5c5d7e05): created successfully Jul 15 18:34:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c3506e-40f2-48c5-9f42-07c01f92952c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Flow 'volume_create_manager' (330abd5b-11c4-4a09-a81e-3046529529d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:22 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a274e91f-1913-4ef9-a4e5-be65e99a3d2b tempest-VolumesCloneNegativeTest-1937322847 None] Created volume successfully. Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Flow 'volume_create_manager' (0646f2bf-90a3-4f08-98bb-a78782bbc6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39877beb-cd45-429e-a421-fd1a48215654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Acquiring lock "cinder-fcf4ca95-f1e9-4108-b516-726c5c5d7e05-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39877beb-cd45-429e-a421-fd1a48215654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-709819677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d81947-9a69-432b-8130-ae2ae429f047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84172b6d060f44ff8d7e749f25a2c5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:23Z,use_quota=True,user_id='e12300d90b644d0fbb989d24e7a15bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a866644-08e9-4396-a73e-8f74f4c02659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a866644-08e9-4396-a73e-8f74f4c02659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8298536a-94b9-453c-a7a2-654cc4888b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8298536a-94b9-453c-a7a2-654cc4888b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d81947-9a69-432b-8130-ae2ae429f047', 'volume_name': 'volume-a1d81947-9a69-432b-8130-ae2ae429f047', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd6eab5-a572-46c0-b21f-6ca41028e7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd6eab5-a572-46c0-b21f-6ca41028e7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9cd7ee-5cf0-412c-b90c-e288210b2e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:23 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Volume a1d81947-9a69-432b-8130-ae2ae429f047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d81947-9a69-432b-8130-ae2ae429f047', 'volume_size': 1} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-709819677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d81947-9a69-432b-8130-ae2ae429f047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84172b6d060f44ff8d7e749f25a2c5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:23Z,use_quota=True,user_id='e12300d90b644d0fbb989d24e7a15bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Creating volume a1d81947-9a69-432b-8130-ae2ae429f047 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:23 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Lock "cinder-fcf4ca95-f1e9-4108-b516-726c5c5d7e05-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:23 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047 1073741824 Jul 15 18:34:23 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Acquiring lock "cinder-quobyte-fcf4ca95-f1e9-4108-b516-726c5c5d7e05" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Lock "cinder-quobyte-fcf4ca95-f1e9-4108-b516-726c5c5d7e05" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed584029-5bbd-4dcf-9d0a-7fafbb67e43d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:23 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05 Jul 15 18:34:23 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:24 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05" returned: 0 in 0.686s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:24 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05 Jul 15 18:34:24 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:24 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047 1073741824" returned: 0 in 0.913s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:24 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047 Jul 15 18:34:24 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:24 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fcf4ca95-f1e9-4108-b516-726c5c5d7e05" returned: 0 in 0.428s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:24 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047" returned: 0 in 0.310s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Lock "cinder-quobyte-fcf4ca95-f1e9-4108-b516-726c5c5d7e05" released by "delete_volume" :: held 1.185s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9cd7ee-5cf0-412c-b90c-e288210b2e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d81947-9a69-432b-8130-ae2ae429f047', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dc4578-f425-4740-923f-c0c6add75565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:24 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Volume volume-a1d81947-9a69-432b-8130-ae2ae429f047 (a1d81947-9a69-432b-8130-ae2ae429f047): created successfully Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dc4578-f425-4740-923f-c0c6add75565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Flow 'volume_create_manager' (0646f2bf-90a3-4f08-98bb-a78782bbc6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:24 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-187b1c19-46a8-4a8c-907d-b5c79932b0a5 tempest-ServersNegativeTestJSON-1075834468 None] Created volume successfully. Jul 15 18:34:24 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Created reservations ['192cef39-002e-499f-b6c1-6bc58217e458', '1b62a3a0-e57e-4e21-beff-09bb658b0578', 'be9834d2-e5f2-4c45-8c57-1f1f109cd9d2', '26481329-0477-451b-b29b-9ae50cf3b80e'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:25 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:34:25 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:25 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.267s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:25 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Deleted volume successfully. Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7f07b348-0ecc-4c07-920d-b43fbc83d165 tempest-VolumesCloneNegativeTest-1937322847 None] Lock "cinder-fcf4ca95-f1e9-4108-b516-726c5c5d7e05-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Flow 'volume_create_manager' (ea6917bb-fa59-4ba3-b43c-0aef8e3583b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a97ebd4-7d28-4670-bcfd-45f9d07f75fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a97ebd4-7d28-4670-bcfd-45f9d07f75fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2077740817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8b27e9-0483-4455-bb09-1828ad3ad665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f97d061ff046c5bf1258ed19094d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:26Z,use_quota=True,user_id='d50a5c4966d94904856eddaa0a88eb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e9fbd8-42ba-4b42-911e-97a70eef62b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e9fbd8-42ba-4b42-911e-97a70eef62b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a05d39-966d-44e7-a054-8c2f912c29f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a05d39-966d-44e7-a054-8c2f912c29f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8b27e9-0483-4455-bb09-1828ad3ad665', 'volume_name': 'volume-3d8b27e9-0483-4455-bb09-1828ad3ad665', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c56b60-6bb0-4402-a663-b57df6abb5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c56b60-6bb0-4402-a663-b57df6abb5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa9efaf-14e0-4805-a729-d076ce30764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:26 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Volume 3d8b27e9-0483-4455-bb09-1828ad3ad665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8b27e9-0483-4455-bb09-1828ad3ad665', 'volume_size': 1} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2077740817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8b27e9-0483-4455-bb09-1828ad3ad665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f97d061ff046c5bf1258ed19094d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:26Z,use_quota=True,user_id='d50a5c4966d94904856eddaa0a88eb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Creating volume 3d8b27e9-0483-4455-bb09-1828ad3ad665 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:26 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:26 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 1073741824 Jul 15 18:34:26 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Acquiring lock "cinder-a1d81947-9a69-432b-8130-ae2ae429f047-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "cinder-a1d81947-9a69-432b-8130-ae2ae429f047-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Acquiring lock "cinder-quobyte-a1d81947-9a69-432b-8130-ae2ae429f047" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "cinder-quobyte-a1d81947-9a69-432b-8130-ae2ae429f047" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[31adaa11-956b-4a8f-bd86-72432b4eda28]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:26 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047 Jul 15 18:34:26 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:26 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 1073741824" returned: 0 in 0.748s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:26 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 Jul 15 18:34:26 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:26 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047" returned: 0 in 0.538s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:26 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047 Jul 15 18:34:26 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:27 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665" returned: 0 in 0.344s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa9efaf-14e0-4805-a729-d076ce30764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8b27e9-0483-4455-bb09-1828ad3ad665', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:27 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985ec2bc-92fe-4000-bed7-726d457e7ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a1d81947-9a69-432b-8130-ae2ae429f047" returned: 0 in 0.328s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "cinder-quobyte-a1d81947-9a69-432b-8130-ae2ae429f047" released by "delete_volume" :: held 0.930s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:27 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Volume volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 (3d8b27e9-0483-4455-bb09-1828ad3ad665): created successfully Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985ec2bc-92fe-4000-bed7-726d457e7ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Flow 'volume_create_manager' (ea6917bb-fa59-4ba3-b43c-0aef8e3583b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d8274a82-c956-4730-b919-107733db4771 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Created volume successfully. Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Created reservations ['e77f407b-0c79-4959-9cd5-8d91faf0b521', 'da7aab65-aeb3-47c2-95b0-5fd5163f776b', '6ef23d38-9375-4fc9-b7da-332962ac8074', 'a6ac06b6-510f-4a9d-88e7-d59fc2b36410'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:27 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:34:27 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:27 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.279s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Deleted volume successfully. Jul 15 18:34:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac89dff0-9c6a-4f5e-a7ea-afc8d15aa2e0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "cinder-a1d81947-9a69-432b-8130-ae2ae429f047-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Creating offline snapshot 2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 of volume 3d8b27e9-0483-4455-bb09-1828ad3ad665 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c13f9e-d8fd-41ba-8786-9efe0c03c0a7]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:28 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 Jul 15 18:34:28 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Acquiring lock "cinder-a4964260-4a4b-47a0-8b69-d1626c631018-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "cinder-a4964260-4a4b-47a0-8b69-d1626c631018-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Acquiring lock "cinder-quobyte-a4964260-4a4b-47a0-8b69-d1626c631018" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:28 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "cinder-quobyte-a4964260-4a4b-47a0-8b69-d1626c631018" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665" returned: 0 in 0.476s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bfc638-ca62-4a18-b3cc-4de80b02c555]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:28 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 1G Jul 15 18:34:28 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:28 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018 Jul 15 18:34:28 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:29 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018" returned: 0 in 0.461s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:29 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018 Jul 15 18:34:29 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:29 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 1G" returned: 0 in 0.574s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:29 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 Jul 15 18:34:29 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:29 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a4964260-4a4b-47a0-8b69-d1626c631018" returned: 0 in 0.356s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "cinder-quobyte-a4964260-4a4b-47a0-8b69-d1626c631018" released by "delete_volume" :: held 0.868s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Created reservations ['6e00c56c-26f3-4c57-939a-ff661c1f66eb', 'd3c2c867-1313-4e64-93a8-8bf4251c385b', '2e001e49-a67d-4bd0-9fc0-15aee0bf8039', '5863bcc2-e872-4a67-a430-a5b3755b8a6e'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:29 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2" returned: 0 in 0.423s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:29 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 is being set with open permissions: ugo+rw Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:29 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 Jul 15 18:34:29 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:29 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:34:29 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (b8a3c875-b9f0-42ab-93f9-a43acca57dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85d0a6e-c05c-4237-82e1-b763996c8546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85d0a6e-c05c-4237-82e1-b763996c8546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-323252027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5836fdf5-dca1-464b-ad7c-b34540c6ccd6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:30Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493771cb-6cf6-4e90-9e7d-4ead3bd16fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493771cb-6cf6-4e90-9e7d-4ead3bd16fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01cd4a4-54ec-4ce3-978d-e797c020c4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01cd4a4-54ec-4ce3-978d-e797c020c4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5836fdf5-dca1-464b-ad7c-b34540c6ccd6', 'volume_name': 'volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb0f44e-bcab-4d05-b609-41fee1bf93b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb0f44e-bcab-4d05-b609-41fee1bf93b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfe1e1d-6c2f-4229-9ea3-4f7abb06be8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:29 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Volume 5836fdf5-dca1-464b-ad7c-b34540c6ccd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6', 'volume_size': 1} Jul 15 18:34:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:30 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2" returned: 0 in 0.374s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:30 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.397s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:30 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:30 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Deleted volume successfully. Jul 15 18:34:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-78af0c25-6950-4743-8e19-6485a9767ae0 tempest-ServersNegativeTestJSON-1075834468 None] Lock "cinder-a4964260-4a4b-47a0-8b69-d1626c631018-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:30 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.info Jul 15 18:34:30 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:30 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.info" returned: 0 in 0.376s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:30 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.info is being set with open permissions: ugo+rw Jul 15 18:34:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:30 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.info Jul 15 18:34:30 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:31 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.info" returned: 0 in 0.750s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.158s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.362s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-323252027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5836fdf5-dca1-464b-ad7c-b34540c6ccd6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:30Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Creating volume 5836fdf5-dca1-464b-ad7c-b34540c6ccd6 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:31 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=81,cinder:INSERT=24,cinder:UPDATE=108,cinder:DELETE=8 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:34:31 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6 1073741824 Jul 15 18:34:31 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:31 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=106,cinder:SELECT=84,cinder:INSERT=35,cinder:DELETE=10 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:34:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-97af79f4-3aa2-4e2b-a229-4701c0fadf12 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Create snapshot completed successfully Jul 15 18:34:32 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6 1073741824" returned: 0 in 0.707s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:32 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6 Jul 15 18:34:32 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:32 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6" returned: 0 in 0.476s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:34:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfe1e1d-6c2f-4229-9ea3-4f7abb06be8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bc843c-c42a-469e-990e-efe97259330e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:32 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Volume volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6 (5836fdf5-dca1-464b-ad7c-b34540c6ccd6): created successfully Jul 15 18:34:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bc843c-c42a-469e-990e-efe97259330e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (b8a3c875-b9f0-42ab-93f9-a43acca57dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:32 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e1dddcd4-f1cb-46d8-bd7a-3227c7cc715f tempest-VolumesGetTest-1900854507 None] Created volume successfully. Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Acquiring lock "cinder-2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "cinder-2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Acquiring lock "cinder-quobyte-3d8b27e9-0483-4455-bb09-1828ad3ad665" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "cinder-quobyte-3d8b27e9-0483-4455-bb09-1828ad3ad665" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Acquiring lock "cinder-quobyte-2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "cinder-quobyte-2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Deleting offline snapshot 2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 of volume 3d8b27e9-0483-4455-bb09-1828ad3ad665 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] snapshot_file for this snap is: volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c0864b-2956-4aa6-af6c-e4ff039f2b34]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:33 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 Jul 15 18:34:33 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:33 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2" returned: 0 in 0.710s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8b27e9-0483-4455-bb09-1828ad3ad665(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1d0d3f-abba-4120-9bfa-3391e0c321a4]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:34 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 Jul 15 18:34:34 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (30dc174d-bfc1-456e-bf4f-e3c725ea073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c3c253-8cad-4462-8b7b-db7178a52348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c3c253-8cad-4462-8b7b-db7178a52348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2050361686',display_name='tempest-VolumesGetTest-Volume-1253622489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15374b6-93b0-4df3-860e-b1f0d12bb165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:34Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5905a13f-1108-4f15-a309-4e07fa0d48de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5905a13f-1108-4f15-a309-4e07fa0d48de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73810942-dea3-47a3-9ab6-70c4f15cbe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73810942-dea3-47a3-9ab6-70c4f15cbe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15374b6-93b0-4df3-860e-b1f0d12bb165', 'volume_name': 'volume-a15374b6-93b0-4df3-860e-b1f0d12bb165', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:34 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2c552e-b8ec-4d14-881f-3512777a4908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2c552e-b8ec-4d14-881f-3512777a4908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b72d04-bc00-4060-b903-d1699e1acd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:34 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Volume a15374b6-93b0-4df3-860e-b1f0d12bb165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15374b6-93b0-4df3-860e-b1f0d12bb165', 'volume_size': 1} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2050361686',display_name='tempest-VolumesGetTest-Volume-1253622489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15374b6-93b0-4df3-860e-b1f0d12bb165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:34Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Creating volume a15374b6-93b0-4df3-860e-b1f0d12bb165 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:34 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665" returned: 0 in 0.698s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:34 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165 1073741824 Jul 15 18:34:34 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:34 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 Jul 15 18:34:34 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:35 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:34:35 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:35 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2" returned: 0 in 0.490s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:35 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2 Jul 15 18:34:35 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:35 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165 1073741824" returned: 0 in 0.679s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:35 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.357s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:34:35 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165 Jul 15 18:34:35 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:35 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665.2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2" returned: 0 in 0.390s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "cinder-quobyte-2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2" released by "_delete_snapshot" :: held 2.499s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "cinder-quobyte-3d8b27e9-0483-4455-bb09-1828ad3ad665" released by "delete_snapshot" :: held 2.550s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Created reservations ['e9ccabe0-c953-4080-9984-84450ad7d033', '27ed5bc7-2e9c-4202-b3e1-275a1ee78776', '032cbc37-ebad-4adf-b7ab-9490c0baa903', '325101c7-498a-4a26-85da-55efdea25515'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:35 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Delete snapshot completed successfully. Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ee96d8eb-4c6c-48b9-bc87-a116e2c17e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "cinder-2f3feb2e-a8ef-4c4f-82b3-53d5dfd475b2-delete_snapshot" released by "delete_snapshot" :: held 2.746s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:35 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165" returned: 0 in 0.450s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b72d04-bc00-4060-b903-d1699e1acd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15374b6-93b0-4df3-860e-b1f0d12bb165', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f812befe-1a72-47aa-8c15-8f2300ba0649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:35 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Volume volume-a15374b6-93b0-4df3-860e-b1f0d12bb165 (a15374b6-93b0-4df3-860e-b1f0d12bb165): created successfully Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f812befe-1a72-47aa-8c15-8f2300ba0649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (30dc174d-bfc1-456e-bf4f-e3c725ea073b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:36 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f15fbeb3-d8ac-40b0-8b47-76a4b129bcd6 tempest-VolumesGetTest-1900854507 None] Created volume successfully. Jul 15 18:34:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Acquiring lock "cinder-3d8b27e9-0483-4455-bb09-1828ad3ad665-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "cinder-3d8b27e9-0483-4455-bb09-1828ad3ad665-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Acquiring lock "cinder-quobyte-3d8b27e9-0483-4455-bb09-1828ad3ad665" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "cinder-quobyte-3d8b27e9-0483-4455-bb09-1828ad3ad665" acquired by "delete_volume" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bfb422-e54d-48c2-8b9b-c690c71028ab]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-a15374b6-93b0-4df3-860e-b1f0d12bb165-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:37 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 Jul 15 18:34:37 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Lock "cinder-a15374b6-93b0-4df3-860e-b1f0d12bb165-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-quobyte-a15374b6-93b0-4df3-860e-b1f0d12bb165" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-a15374b6-93b0-4df3-860e-b1f0d12bb165" acquired by "delete_volume" :: waited 0.050s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:37 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5d79b5-f647-4292-bcd8-ce9d346e15ab]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:37 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165 Jul 15 18:34:37 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:37 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665" returned: 0 in 0.797s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:37 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665 Jul 15 18:34:37 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:38 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3d8b27e9-0483-4455-bb09-1828ad3ad665" returned: 0 in 0.585s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "cinder-quobyte-3d8b27e9-0483-4455-bb09-1828ad3ad665" released by "delete_volume" :: held 1.584s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:38 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165" returned: 0 in 1.207s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Created reservations ['63f6c5da-dde4-4200-ab6f-e45ca775b32b', 'f41d914d-5458-44df-9f91-0d4aa858bab7', '5a2a580a-7151-4fd8-9e6d-ac2e6587683f', 'a78c1040-e99d-4cf9-b292-dfbe718915d5'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:38 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165 Jul 15 18:34:38 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:38 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:34:38 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:39 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a15374b6-93b0-4df3-860e-b1f0d12bb165" returned: 0 in 0.570s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-a15374b6-93b0-4df3-860e-b1f0d12bb165" released by "delete_volume" :: held 1.904s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:39 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.725s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:39 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Deleted volume successfully. Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Created reservations ['58a212b0-9fb3-460c-910d-c6b5f7700914', 'f2fa8961-9f47-40a1-be6d-f8f3e8dc70ee', '94ba0f59-3e95-40f2-9d46-53871256834d', '0c31537a-d010-4ba0-97a9-54715fccc647'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df09051f-a622-4ba5-bafd-ae18d3a58bfd tempest-VolumeSnapshotQuotasNegativeTestJSON-588004952 None] Lock "cinder-3d8b27e9-0483-4455-bb09-1828ad3ad665-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:39 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:34:39 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:40 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.485s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:40 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:40 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Deleted volume successfully. Jul 15 18:34:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-71d905fa-6ee2-413b-8579-2f4d49383b6b tempest-VolumesGetTest-1900854507 None] Lock "cinder-a15374b6-93b0-4df3-860e-b1f0d12bb165-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-5836fdf5-dca1-464b-ad7c-b34540c6ccd6-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Lock "cinder-5836fdf5-dca1-464b-ad7c-b34540c6ccd6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-quobyte-5836fdf5-dca1-464b-ad7c-b34540c6ccd6" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-5836fdf5-dca1-464b-ad7c-b34540c6ccd6" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:40 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d013a4bd-db58-4b3d-a1be-5601c21ab5c4]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:41 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6 Jul 15 18:34:41 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:41 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6" returned: 0 in 0.862s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:41 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6 Jul 15 18:34:41 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:42 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5836fdf5-dca1-464b-ad7c-b34540c6ccd6" returned: 0 in 0.489s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-5836fdf5-dca1-464b-ad7c-b34540c6ccd6" released by "delete_volume" :: held 1.435s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:42 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Created reservations ['f12dac84-ae03-4c41-a1a1-985f1f0b6750', '74355c15-3094-486a-9e38-73a798339669', '48101d23-1b4f-4880-b6da-f7314aa66637', '95201f1e-804e-493b-838c-a6b4f718cca3'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:42 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:34:42 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:43 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.540s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:43 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Deleted volume successfully. Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f00db87-cfc9-4b52-b2f8-bafefa144a57 tempest-VolumesGetTest-1900854507 None] Lock "cinder-5836fdf5-dca1-464b-ad7c-b34540c6ccd6-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (5d57e609-e71c-4999-b98e-631496e804c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c973a2-fc97-429c-bd1a-16865adf5bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c973a2-fc97-429c-bd1a-16865adf5bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-48535271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcc1b0e-5b35-4d78-826b-88992fe81de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:44Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fd066a-b81d-41e8-a8f8-1d9aad11e5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fd066a-b81d-41e8-a8f8-1d9aad11e5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2aeb1a-97e9-4c70-ad4a-966e9cc78176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2aeb1a-97e9-4c70-ad4a-966e9cc78176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcc1b0e-5b35-4d78-826b-88992fe81de8', 'volume_name': 'volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98470ad2-d30f-491a-9d32-8d4b82e5461a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98470ad2-d30f-491a-9d32-8d4b82e5461a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de965f4-b8a3-463d-9b43-86879c359196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:43 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Volume ebcc1b0e-5b35-4d78-826b-88992fe81de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8', 'volume_size': 1} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-48535271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcc1b0e-5b35-4d78-826b-88992fe81de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:44Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Creating volume ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:44 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:34:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:44 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 1073741824 Jul 15 18:34:44 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:44 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 1073741824" returned: 0 in 0.919s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:45 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 Jul 15 18:34:45 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:45 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8" returned: 0 in 0.362s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:34:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de965f4-b8a3-463d-9b43-86879c359196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8c549b-1c28-44df-b811-23b1f179c882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Volume volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 (ebcc1b0e-5b35-4d78-826b-88992fe81de8): created successfully Jul 15 18:34:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8c549b-1c28-44df-b811-23b1f179c882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (5d57e609-e71c-4999-b98e-631496e804c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-97c523b9-cc54-4544-b0ab-177b85380447 tempest-VolumesGetTest-1900854507 None] Created volume successfully. Jul 15 18:34:46 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (1f4cbed0-a87e-4903-8738-a0f9cbc7b72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2007b08-1e64-4218-a87f-e2026c436a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2007b08-1e64-4218-a87f-e2026c436a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-937675130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819d7725-d5bb-4128-b631-b39551860789,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ebcc1b0e-5b35-4d78-826b-88992fe81de8,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:47Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185b95c7-3a86-4364-bce3-02257eb13de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185b95c7-3a86-4364-bce3-02257eb13de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961f550a-c7c5-4d72-bec2-636268cfc822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961f550a-c7c5-4d72-bec2-636268cfc822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '819d7725-d5bb-4128-b631-b39551860789', 'volume_name': 'volume-819d7725-d5bb-4128-b631-b39551860789', 'volume_size': 1, 'source_volid': 'ebcc1b0e-5b35-4d78-826b-88992fe81de8', 'source_volstatus': 'available'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de15e9f7-3157-4cc1-b3b9-6e30accc06d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de15e9f7-3157-4cc1-b3b9-6e30accc06d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd3c8fd-7fd9-4234-8e00-aeb0d2f00f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:47 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Volume 819d7725-d5bb-4128-b631-b39551860789: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-819d7725-d5bb-4128-b631-b39551860789', 'volume_size': 1, 'source_volid': 'ebcc1b0e-5b35-4d78-826b-88992fe81de8', 'source_volstatus': 'available'} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:47 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Cloning volume ebcc1b0e-5b35-4d78-826b-88992fe81de8 to volume 819d7725-d5bb-4128-b631-b39551860789 Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Creating offline snapshot c30f36fa-1715-4e3f-ace7-869f78fa43c4 of volume ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7959f6a3-ae7b-4983-8d87-07a5d68e6643]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:47 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 Jul 15 18:34:47 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:47 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8" returned: 0 in 0.696s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:48 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 1G Jul 15 18:34:48 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:48 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 1G" returned: 0 in 0.583s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:48 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 Jul 15 18:34:48 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:48 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4" returned: 0 in 0.469s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:49 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 is being set with open permissions: ugo+rw Jul 15 18:34:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:49 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 Jul 15 18:34:49 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:49 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4" returned: 0 in 0.323s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:49 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.info Jul 15 18:34:49 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:49 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.info" returned: 0 in 0.364s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:49 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.info is being set with open permissions: ugo+rw Jul 15 18:34:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:49 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.info Jul 15 18:34:49 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:50 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.info" returned: 0 in 0.338s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-quobyte-819d7725-d5bb-4128-b631-b39551860789" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-819d7725-d5bb-4128-b631-b39551860789" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] snapshot: c30f36fa-1715-4e3f-ace7-869f78fa43c4, volume: 819d7725-d5bb-4128-b631-b39551860789, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[563ffc06-cae3-4a60-b2e0-df3b215fa69f]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:50 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 Jul 15 18:34:50 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:50 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4" returned: 0 in 0.641s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6537b7a-47e8-4b64-b626-62048b765fe8]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:50 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Flow 'volume_create_manager' (3fdc0cbb-1585-42b5-a101-d20e618272b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9337a98f-9b10-4a07-9257-6a69e40b6ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:51 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 Jul 15 18:34:51 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9337a98f-9b10-4a07-9257-6a69e40b6ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2137691932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c110b233-12b3-49e7-bbc6-1d658c9caa8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1052fb8574274638a3db4eadfd1be222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:51Z,use_quota=True,user_id='f95a4ba8873d45089793b7d70e19fa9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43077a1a-dd4a-449e-ad34-93cc635e6d63),volume_type_id=43077a1a-dd4a-449e-ad34-93cc635e6d63)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67365a3f-118e-4def-99e8-8c0264971d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67365a3f-118e-4def-99e8-8c0264971d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80425a8b-88ed-4c8e-af14-bb3efcc4068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80425a8b-88ed-4c8e-af14-bb3efcc4068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c110b233-12b3-49e7-bbc6-1d658c9caa8f', 'volume_name': 'volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4702754-6198-4d14-83ac-0a0ebfe76929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4702754-6198-4d14-83ac-0a0ebfe76929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd817b6-3595-4088-bfcc-fa3f5a776973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:51 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Volume c110b233-12b3-49e7-bbc6-1d658c9caa8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f', 'volume_size': 1} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:51 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8" returned: 0 in 0.565s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:34:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:51 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 Jul 15 18:34:51 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:57 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789" returned: 0 in 5.620s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03de1da-adde-4149-8d37-bc6f27e241cf]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:57 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 Jul 15 18:34:57 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:57 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8" returned: 0 in 0.584s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:34:57 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Converted 1024.00 MB image at 182.14 MB/s Jul 15 18:34:57 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 is being set with open permissions: ugo+rw Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:57 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 Jul 15 18:34:57 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:57 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789" returned: 0 in 0.278s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-819d7725-d5bb-4128-b631-b39551860789" released by "_copy_volume_from_snapshot" :: held 7.798s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-quobyte-c30f36fa-1715-4e3f-ace7-869f78fa43c4" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-c30f36fa-1715-4e3f-ace7-869f78fa43c4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Deleting offline snapshot c30f36fa-1715-4e3f-ace7-869f78fa43c4 of volume ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:34:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] snapshot_file for this snap is: volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:34:58 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c66c36-ab36-42c7-8d21-c29a32d167af]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:58 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 Jul 15 18:34:58 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:58 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4" returned: 0 in 0.474s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:58 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2541b16-5c46-4bf4-ab5a-fe2d605e9df0]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:58 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 Jul 15 18:34:58 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:59 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8" returned: 0 in 0.470s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:59 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 Jul 15 18:34:59 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:59 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4" returned: 0 in 0.421s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:59 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4 Jul 15 18:34:59 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:59 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8.c30f36fa-1715-4e3f-ace7-869f78fa43c4" returned: 0 in 0.302s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-c30f36fa-1715-4e3f-ace7-869f78fa43c4" released by "_delete_snapshot" :: held 1.803s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.683s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.737s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2137691932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c110b233-12b3-49e7-bbc6-1d658c9caa8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1052fb8574274638a3db4eadfd1be222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:51Z,use_quota=True,user_id='f95a4ba8873d45089793b7d70e19fa9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43077a1a-dd4a-449e-ad34-93cc635e6d63),volume_type_id=43077a1a-dd4a-449e-ad34-93cc635e6d63)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Creating volume c110b233-12b3-49e7-bbc6-1d658c9caa8f {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:59 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:59 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f 1073741824 Jul 15 18:34:59 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd3c8fd-7fd9-4234-8e00-aeb0d2f00f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819d7725-d5bb-4128-b631-b39551860789', 'volume_size': 1, 'source_volid': 'ebcc1b0e-5b35-4d78-826b-88992fe81de8', 'source_volstatus': 'available'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069f5599-7e17-4687-9595-bd1e0b8d549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:59 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Volume volume-819d7725-d5bb-4128-b631-b39551860789 (819d7725-d5bb-4128-b631-b39551860789): created successfully Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069f5599-7e17-4687-9595-bd1e0b8d549c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (1f4cbed0-a87e-4903-8738-a0f9cbc7b72e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-37f1ad89-128f-4d0a-a36a-2479dab32580 tempest-VolumesGetTest-1900854507 None] Created volume successfully. Jul 15 18:35:00 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f 1073741824" returned: 0 in 0.532s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:00 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f Jul 15 18:35:00 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:00 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f" returned: 0 in 0.301s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd817b6-3595-4088-bfcc-fa3f5a776973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5572589b-02ce-4dd1-b44a-bf847b025f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:00 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Volume volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f (c110b233-12b3-49e7-bbc6-1d658c9caa8f): created successfully Jul 15 18:35:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5572589b-02ce-4dd1-b44a-bf847b025f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Flow 'volume_create_manager' (3fdc0cbb-1585-42b5-a101-d20e618272b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-aaf36cbb-44ec-4586-afe8-ba08870eca0a tempest-VolumeTypesAccessTest-556937533 None] Created volume successfully. Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Acquiring lock "cinder-c110b233-12b3-49e7-bbc6-1d658c9caa8f-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Lock "cinder-c110b233-12b3-49e7-bbc6-1d658c9caa8f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Acquiring lock "cinder-quobyte-c110b233-12b3-49e7-bbc6-1d658c9caa8f" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Lock "cinder-quobyte-c110b233-12b3-49e7-bbc6-1d658c9caa8f" acquired by "delete_volume" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3a6dc1-008b-4205-813b-5b70851d4816]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (8cdb54b1-bb27-438e-92a7-e63b33d97754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e12a3d1-4946-49d8-bf30-d01029224c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:01 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f Jul 15 18:35:01 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e12a3d1-4946-49d8-bf30-d01029224c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-431089056',display_name='tempest-VolumesGetTest-Volume-143082912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6966ff1-2e1b-4f4e-b09d-92420491a59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:01Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a288780-e0ac-4f46-8b57-b00ca64ca2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a288780-e0ac-4f46-8b57-b00ca64ca2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38938878-b64a-4844-bfd4-02d415f196d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38938878-b64a-4844-bfd4-02d415f196d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6966ff1-2e1b-4f4e-b09d-92420491a59f', 'volume_name': 'volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3973bd-6731-46e1-b9a2-fcf3d8d5ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3973bd-6731-46e1-b9a2-fcf3d8d5ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda32a05-d91c-430c-aa6c-8a0cff4e0ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:01 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Volume a6966ff1-2e1b-4f4e-b09d-92420491a59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f', 'volume_size': 1} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-431089056',display_name='tempest-VolumesGetTest-Volume-143082912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6966ff1-2e1b-4f4e-b09d-92420491a59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:01Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Creating volume a6966ff1-2e1b-4f4e-b09d-92420491a59f {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:01 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:01 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f 1073741824 Jul 15 18:35:01 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:01 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f" returned: 0 in 0.445s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:01 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f Jul 15 18:35:01 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:01 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c110b233-12b3-49e7-bbc6-1d658c9caa8f" returned: 0 in 0.286s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Lock "cinder-quobyte-c110b233-12b3-49e7-bbc6-1d658c9caa8f" released by "delete_volume" :: held 0.786s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:01 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f 1073741824" returned: 0 in 0.551s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:02 devstack cinder-volume[87863]: WARNING cinder.quota [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1410336879 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1410336879, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:35:02 devstack cinder-volume[87863]: WARNING cinder.quota [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1410336879 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1410336879, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Created reservations ['b0c0dba0-a16c-4007-88b4-f7af2614979b', '898c35e5-a582-451b-a80e-2ad93333798f', '84003a12-34d7-4519-a1a7-b11c52f46da4', 'fcb13dc0-b5c3-467d-8d8f-a28c7d8eb3d9'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:02 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f Jul 15 18:35:02 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:02 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:35:02 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:02 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f" returned: 0 in 0.313s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda32a05-d91c-430c-aa6c-8a0cff4e0ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d94ce67-8ff6-477a-bd99-5ba6997106c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:02 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Volume volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f (a6966ff1-2e1b-4f4e-b09d-92420491a59f): created successfully Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d94ce67-8ff6-477a-bd99-5ba6997106c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (8cdb54b1-bb27-438e-92a7-e63b33d97754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:02 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ddf0a09e-5b8f-48fb-b74a-dcfb255640d3 tempest-VolumesGetTest-1900854507 None] Created volume successfully. Jul 15 18:35:02 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.401s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:02 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Deleted volume successfully. Jul 15 18:35:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8d36ffbe-c681-4697-a1cb-bb25beb9928b tempest-VolumeTypesAccessTest-556937533 None] Lock "cinder-c110b233-12b3-49e7-bbc6-1d658c9caa8f-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-a6966ff1-2e1b-4f4e-b09d-92420491a59f-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Lock "cinder-a6966ff1-2e1b-4f4e-b09d-92420491a59f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-quobyte-a6966ff1-2e1b-4f4e-b09d-92420491a59f" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-a6966ff1-2e1b-4f4e-b09d-92420491a59f" acquired by "delete_volume" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:03 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c03ab45-4cc8-46c9-b86e-083c6eb6bd6d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:03 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f Jul 15 18:35:03 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:04 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f" returned: 0 in 0.449s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:04 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f Jul 15 18:35:04 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:04 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a6966ff1-2e1b-4f4e-b09d-92420491a59f" returned: 0 in 0.293s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-a6966ff1-2e1b-4f4e-b09d-92420491a59f" released by "delete_volume" :: held 0.798s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Created reservations ['9d28921c-a960-447f-8152-e931454522c0', '94d6fd9c-2967-4709-9c78-d410dc1fc13c', '44eb0e7d-0154-4992-8e31-24eb5b297f28', '12a6a492-b007-4a3f-962e-5ba035036092'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:04 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:35:04 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-819d7725-d5bb-4128-b631-b39551860789-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Lock "cinder-819d7725-d5bb-4128-b631-b39551860789-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-quobyte-819d7725-d5bb-4128-b631-b39551860789" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-819d7725-d5bb-4128-b631-b39551860789" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:05 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.402s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:05 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:05 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Deleted volume successfully. Jul 15 18:35:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e972d406-9e63-4dc2-9856-ca3187c4a766]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b828ae2d-8557-4daf-97d6-f4f6ec26f105 tempest-VolumesGetTest-1900854507 None] Lock "cinder-a6966ff1-2e1b-4f4e-b09d-92420491a59f-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:05 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 Jul 15 18:35:05 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:05 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789" returned: 0 in 0.565s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:05 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789 Jul 15 18:35:05 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:06 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-819d7725-d5bb-4128-b631-b39551860789" returned: 0 in 0.337s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-819d7725-d5bb-4128-b631-b39551860789" released by "delete_volume" :: held 0.970s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Created reservations ['3d92b475-45a4-47bb-871c-2375bb79607d', '969481f2-0727-4427-a7d0-a3ca07e86a16', '67595dac-cf3f-43cb-ad0e-4ce4ec356171', 'ee679638-b64d-4a10-84f3-745284402009'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:06 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:35:06 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Flow 'volume_create_manager' (db55df92-8599-4c58-8df4-291253acb23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24189b4c-19cc-4f80-8e42-f0383290dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24189b4c-19cc-4f80-8e42-f0383290dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1694862085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e390a6-1c15-4656-a260-16d5aa85ee36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f181fc641f4680b0aacfcdb20faae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:06Z,use_quota=True,user_id='7806163100dc4e36b8ced197853d1634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b54079c-7dae-445f-a283-f70c5b2f15ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b54079c-7dae-445f-a283-f70c5b2f15ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274378d4-473b-4daf-89f0-bfc38fef1971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274378d4-473b-4daf-89f0-bfc38fef1971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e390a6-1c15-4656-a260-16d5aa85ee36', 'volume_name': 'volume-d1e390a6-1c15-4656-a260-16d5aa85ee36', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699f3f5f-9b3c-41ea-bece-6c14bdc058d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699f3f5f-9b3c-41ea-bece-6c14bdc058d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9634d63d-a640-447b-a2e4-5721ee279f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:06 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Volume d1e390a6-1c15-4656-a260-16d5aa85ee36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e390a6-1c15-4656-a260-16d5aa85ee36', 'volume_size': 1} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1694862085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e390a6-1c15-4656-a260-16d5aa85ee36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f181fc641f4680b0aacfcdb20faae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:06Z,use_quota=True,user_id='7806163100dc4e36b8ced197853d1634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Creating volume d1e390a6-1c15-4656-a260-16d5aa85ee36 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:06 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:06 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 1073741824 Jul 15 18:35:06 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:06 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.438s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Deleted volume successfully. Jul 15 18:35:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-beafdd76-666e-40a1-9db9-049dd1d5fe25 tempest-VolumesGetTest-1900854507 None] Lock "cinder-819d7725-d5bb-4128-b631-b39551860789-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:07 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 1073741824" returned: 0 in 0.649s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-ebcc1b0e-5b35-4d78-826b-88992fe81de8-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Lock "cinder-ebcc1b0e-5b35-4d78-826b-88992fe81de8-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:07 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 Jul 15 18:35:07 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-quobyte-ebcc1b0e-5b35-4d78-826b-88992fe81de8" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-ebcc1b0e-5b35-4d78-826b-88992fe81de8" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f426b28f-f560-405e-8cb9-e05a0c0742fb]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:07 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36" returned: 0 in 0.342s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:07 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 Jul 15 18:35:07 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9634d63d-a640-447b-a2e4-5721ee279f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e390a6-1c15-4656-a260-16d5aa85ee36', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a7836c-0436-4822-827e-e5af3a97cde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:07 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Volume volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 (d1e390a6-1c15-4656-a260-16d5aa85ee36): created successfully Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a7836c-0436-4822-827e-e5af3a97cde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Flow 'volume_create_manager' (db55df92-8599-4c58-8df4-291253acb23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:07 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9fcf6413-6a6b-457a-9f65-f63772df48dc tempest-AttachVolumeTestJSON-1801034467 None] Created volume successfully. Jul 15 18:35:08 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8" returned: 0 in 0.446s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:08 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8 Jul 15 18:35:08 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:08 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebcc1b0e-5b35-4d78-826b-88992fe81de8" returned: 0 in 0.287s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-ebcc1b0e-5b35-4d78-826b-88992fe81de8" released by "delete_volume" :: held 0.821s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Created reservations ['46fc47a0-3fed-4aa5-8976-8111737187d3', '4d75f237-f4a4-4ac8-ab42-c198a5ddf7fe', 'c45a98a2-e6e1-4e5b-b496-2e3b080e4077', 'd70e331b-2fd0-475b-9e8f-9fd06f4d44aa'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:08 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:35:08 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:08 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.409s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:08 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:08 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Deleted volume successfully. Jul 15 18:35:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0cdb77f-caf6-496f-9600-704b15480bf7 tempest-VolumesGetTest-1900854507 None] Lock "cinder-ebcc1b0e-5b35-4d78-826b-88992fe81de8-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:09 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (f1102181-e557-44a7-bd4b-df006d838ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1262e7ac-ce55-477b-8e12-c2c06006ff05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1262e7ac-ce55-477b-8e12-c2c06006ff05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-823653526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46fa8cb-3a64-4e01-bd67-552d24ef470f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:10Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741f1201-1158-4ee5-a29b-e61141fe1c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741f1201-1158-4ee5-a29b-e61141fe1c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6baca4ab-fd4c-4f68-b8e1-e865bf4036cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:09 devstack cinder-volume[87863]: DEBUG cinder.image.glance [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Creating Keystone auth plugin from conf {{(pid=87863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:35:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6baca4ab-fd4c-4f68-b8e1-e865bf4036cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f46fa8cb-3a64-4e01-bd67-552d24ef470f', 'volume_name': 'volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30eb5bcf-9ecd-4624-b423-b88ac8ce1659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30eb5bcf-9ecd-4624-b423-b88ac8ce1659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8244fc09-6ab5-49ff-b000-7c26a570e54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:10 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Volume f46fa8cb-3a64-4e01-bd67-552d24ef470f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 15 18:35:10 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Trying to clone f46fa8cb-3a64-4e01-bd67-552d24ef470f from image 26627af3-14a2-4924-a235-ca96adb6f0af at location (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]). {{(pid=87863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:35:11 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Image download 20.69 MB at 20.69 MB/s Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-ea3c38fa-d85d-4024-9d92-28c56da6fff3 req-846daafb-eb85-4d15-9c9f-5f7b26ce7130 tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-ea3c38fa-d85d-4024-9d92-28c56da6fff3 req-846daafb-eb85-4d15-9c9f-5f7b26ce7130 tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5415247-b9d7-4e7e-847a-c8f227aac88e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-ea3c38fa-d85d-4024-9d92-28c56da6fff3 req-846daafb-eb85-4d15-9c9f-5f7b26ce7130 tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4167436b-9427-4411-9476-724d201c3b89]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:11 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 Jul 15 18:35:11 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:11 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD Jul 15 18:35:11 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:11 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Temporary image 26627af3-14a2-4924-a235-ca96adb6f0af is fetched for user fcaca0db224246e3981f316ac0e0bf63. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:35:11 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-ea3c38fa-d85d-4024-9d92-28c56da6fff3 req-846daafb-eb85-4d15-9c9f-5f7b26ce7130 tempest-AttachVolumeTestJSON-1801034467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36" returned: 0 in 0.603s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-ea3c38fa-d85d-4024-9d92-28c56da6fff3 req-846daafb-eb85-4d15-9c9f-5f7b26ce7130 tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.644s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-ea3c38fa-d85d-4024-9d92-28c56da6fff3 req-846daafb-eb85-4d15-9c9f-5f7b26ce7130 tempest-AttachVolumeTestJSON-1801034467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-d1e390a6-1c15-4656-a260-16d5aa85ee36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '230d696b-b431-467c-8478-d03e9586c843', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0faa95-c6bc-45b6-ba11-aac6721622e8]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:12 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-ea3c38fa-d85d-4024-9d92-28c56da6fff3 req-846daafb-eb85-4d15-9c9f-5f7b26ce7130 tempest-AttachVolumeTestJSON-1801034467 None] attachment_update completed successfully. Jul 15 18:35:12 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD Jul 15 18:35:12 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:12 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-823653526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46fa8cb-3a64-4e01-bd67-552d24ef470f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:10Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Creating volume f46fa8cb-3a64-4e01-bd67-552d24ef470f {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:12 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:35:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:12 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f 1073741824 Jul 15 18:35:12 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:13 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f 1073741824" returned: 0 in 0.809s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:13 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f Jul 15 18:35:13 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:13 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f" returned: 0 in 0.344s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:13 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Attempting download of 26627af3-14a2-4924-a235-ca96adb6f0af ((None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}])) to volume f46fa8cb-3a64-4e01-bd67-552d24ef470f. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:35:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c31a5ef-a5fc-483c-a155-2de1a34ecd0b]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_i7u4zouw {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:14 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_i7u4zouw Jul 15 18:35:14 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:14 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_i7u4zouw" returned: 0 in 0.594s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_i7u4zouw {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:14 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_i7u4zouw Jul 15 18:35:14 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:15 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_i7u4zouw" returned: 1 in 0.584s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_i7u4zouw' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:35:15 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd588eb5-5330-4805-988e-2c7eac56eb8c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:15 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD Jul 15 18:35:15 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:15 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD" returned: 0 in 0.649s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:15 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] 26627af3-14a2-4924-a235-ca96adb6f0af was qcow2, converting to raw {{(pid=87863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:35:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:15 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f Jul 15 18:35:15 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:18 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f" returned: 0 in 2.885s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:18 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_6gs1l5yddevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:35:18 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Converted 112.00 MB image at 38.74 MB/s Jul 15 18:35:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:18 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f 1G Jul 15 18:35:18 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:19 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f 1G" returned: 0 in 0.663s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:19 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a2a825-07b5-4cf8-8b42-8e7967859c19]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:19 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f Jul 15 18:35:19 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:20 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f" returned: 0 in 1.005s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:20 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f Jul 15 18:35:20 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:21 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f" returned: 1 in 0.668s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Downloaded image 26627af3-14a2-4924-a235-ca96adb6f0af ((None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}])) to volume f46fa8cb-3a64-4e01-bd67-552d24ef470f successfully. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Temporary image 26627af3-14a2-4924-a235-ca96adb6f0af for user fcaca0db224246e3981f316ac0e0bf63 is deleted. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Marking volume f46fa8cb-3a64-4e01-bd67-552d24ef470f as bootable. {{(pid=87863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Copying metadata from image 26627af3-14a2-4924-a235-ca96adb6f0af to f46fa8cb-3a64-4e01-bd67-552d24ef470f. {{(pid=87863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Creating volume glance metadata for volume f46fa8cb-3a64-4e01-bd67-552d24ef470f backed by image 26627af3-14a2-4924-a235-ca96adb6f0af with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8244fc09-6ab5-49ff-b000-7c26a570e54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50e719c-445e-482e-a070-f7000435b002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Volume volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f (f46fa8cb-3a64-4e01-bd67-552d24ef470f): created successfully Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50e719c-445e-482e-a070-f7000435b002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (f1102181-e557-44a7-bd4b-df006d838ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:21 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5eb51042-e826-4395-90dc-ba60e4a573f8 tempest-VolumesGetTest-1900854507 None] Created volume successfully. Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (1b6ffe1c-bb0d-4c44-8c1c-f8b15aba52e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515290c8-9f20-43ec-bc89-5a9ab17bd429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515290c8-9f20-43ec-bc89-5a9ab17bd429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-161965893',display_name='tempest-VolumesGetTest-Volume-1538502673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c76ee2-dce8-4056-9b86-f70c59e7b2e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:25Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a200a7bd-3901-42b3-99ff-eb88869d817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a200a7bd-3901-42b3-99ff-eb88869d817c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68dba6c5-4a72-4d6f-ac9b-e4153434959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68dba6c5-4a72-4d6f-ac9b-e4153434959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c76ee2-dce8-4056-9b86-f70c59e7b2e1', 'volume_name': 'volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26c8e33-ed4c-4000-9aa8-cbea392eb173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26c8e33-ed4c-4000-9aa8-cbea392eb173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd1c3f3-b7eb-4dab-8beb-7b7cb2c459a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:24 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Volume 95c76ee2-dce8-4056-9b86-f70c59e7b2e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1', 'volume_size': 1} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-161965893',display_name='tempest-VolumesGetTest-Volume-1538502673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c76ee2-dce8-4056-9b86-f70c59e7b2e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72662afc41384573a4c7f4b4c67b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:25Z,use_quota=True,user_id='fcaca0db224246e3981f316ac0e0bf63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Creating volume 95c76ee2-dce8-4056-9b86-f70c59e7b2e1 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:24 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:35:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:24 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1 1073741824 Jul 15 18:35:24 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:25 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1 1073741824" returned: 0 in 0.905s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:25 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1 Jul 15 18:35:25 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:26 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1" returned: 0 in 0.405s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd1c3f3-b7eb-4dab-8beb-7b7cb2c459a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e8b461-4c6a-466e-bddd-fbd648706cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:26 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Volume volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1 (95c76ee2-dce8-4056-9b86-f70c59e7b2e1): created successfully Jul 15 18:35:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e8b461-4c6a-466e-bddd-fbd648706cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Flow 'volume_create_manager' (1b6ffe1c-bb0d-4c44-8c1c-f8b15aba52e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:26 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5ec5d20e-7115-467f-80c6-9b6df4009ab0 tempest-VolumesGetTest-1900854507 None] Created volume successfully. Jul 15 18:35:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-95c76ee2-dce8-4056-9b86-f70c59e7b2e1-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Lock "cinder-95c76ee2-dce8-4056-9b86-f70c59e7b2e1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-quobyte-95c76ee2-dce8-4056-9b86-f70c59e7b2e1" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-95c76ee2-dce8-4056-9b86-f70c59e7b2e1" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:27 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[513c274e-037d-4d83-8700-9f26ff4e6825]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:27 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1 Jul 15 18:35:27 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:27 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1" returned: 0 in 0.552s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:27 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1 Jul 15 18:35:27 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:28 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-95c76ee2-dce8-4056-9b86-f70c59e7b2e1" returned: 0 in 0.484s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-95c76ee2-dce8-4056-9b86-f70c59e7b2e1" released by "delete_volume" :: held 1.117s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Created reservations ['cef95a95-76de-4836-8271-61afc7a4750d', '32fa8512-c709-4091-8576-05ad935ca04f', 'c38f9b0c-3c18-43f0-981c-2d8941900af2', '8101d68b-50fb-465d-93c5-7ec6546c0d8f'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:28 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:35:28 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:28 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.302s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:28 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Deleted volume successfully. Jul 15 18:35:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-df82ff7f-14d1-4e10-8eb0-99c5ea103094 tempest-VolumesGetTest-1900854507 None] Lock "cinder-95c76ee2-dce8-4056-9b86-f70c59e7b2e1-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-f46fa8cb-3a64-4e01-bd67-552d24ef470f-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Lock "cinder-f46fa8cb-3a64-4e01-bd67-552d24ef470f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Acquiring lock "cinder-quobyte-f46fa8cb-3a64-4e01-bd67-552d24ef470f" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-f46fa8cb-3a64-4e01-bd67-552d24ef470f" acquired by "delete_volume" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:29 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec413bc8-ce37-4db4-9e76-871e68e0a414]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:30 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f Jul 15 18:35:30 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:30 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f" returned: 0 in 0.471s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:30 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f Jul 15 18:35:30 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:30 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f" returned: 1 in 0.471s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:35:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:30 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f Jul 15 18:35:30 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:31 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f46fa8cb-3a64-4e01-bd67-552d24ef470f" returned: 0 in 0.351s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Lock "cinder-quobyte-f46fa8cb-3a64-4e01-bd67-552d24ef470f" released by "delete_volume" :: held 1.383s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Created reservations ['fe253cd3-5166-445a-97cb-9efe83c9f386', '065fd7d2-9b0e-494e-ba80-4c9a10572c9c', 'b7cb3931-6ecd-4a6e-a4f7-dc3ef1b2d8c2', '14a0c649-e553-4da5-889c-d69243cda899'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:31 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:35:31 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:31 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.372s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Deleted volume successfully. Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:DELETE=11,cinder:SELECT=85,cinder:UPDATE=101,cinder:INSERT=25 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:35:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7effd07f-6b58-4b27-ab19-5b9b796fd552 tempest-VolumesGetTest-1900854507 None] Lock "cinder-f46fa8cb-3a64-4e01-bd67-552d24ef470f-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:35 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:35:35 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:35 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.363s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:35:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=84,cinder:UPDATE=117,cinder:INSERT=39,cinder:DELETE=8 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Flow 'volume_create_manager' (91a2bc96-bfbf-4fef-a325-cad23a7f4a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59aa3fd9-5a97-4b71-9d7c-d9ffdbd69010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59aa3fd9-5a97-4b71-9d7c-d9ffdbd69010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1585012660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49b2050-dd24-44f6-8a68-36ed55ea5bc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f451e3bcac5247f3a2fd4f0541481cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:36Z,use_quota=True,user_id='e63543f2f2d9469082a99d9eeaf34f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e66e652-124b-4f07-8b82-a45316433a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e66e652-124b-4f07-8b82-a45316433a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661acaca-f9fb-4728-b153-127ccce9c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661acaca-f9fb-4728-b153-127ccce9c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49b2050-dd24-44f6-8a68-36ed55ea5bc7', 'volume_name': 'volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad2d5b3-a218-491f-9111-3f1220ccb287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad2d5b3-a218-491f-9111-3f1220ccb287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce29685-24ae-4239-9fb3-cf7ff051eadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:36 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Volume f49b2050-dd24-44f6-8a68-36ed55ea5bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7', 'volume_size': 1} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1585012660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49b2050-dd24-44f6-8a68-36ed55ea5bc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f451e3bcac5247f3a2fd4f0541481cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:36Z,use_quota=True,user_id='e63543f2f2d9469082a99d9eeaf34f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Creating volume f49b2050-dd24-44f6-8a68-36ed55ea5bc7 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:36 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:35:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:36 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7 1073741824 Jul 15 18:35:36 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:37 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7 1073741824" returned: 0 in 0.560s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:37 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7 Jul 15 18:35:37 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:37 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7" returned: 0 in 0.396s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce29685-24ae-4239-9fb3-cf7ff051eadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab9ef8c-ee4a-4f44-94cf-1d0c2de4558e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Volume volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7 (f49b2050-dd24-44f6-8a68-36ed55ea5bc7): created successfully Jul 15 18:35:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab9ef8c-ee4a-4f44-94cf-1d0c2de4558e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Flow 'volume_create_manager' (91a2bc96-bfbf-4fef-a325-cad23a7f4a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d6fe916c-7f2f-49bc-bcb4-0baff77ee806 tempest-VolumesListTestJSON-170186896 None] Created volume successfully. Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Flow 'volume_create_manager' (4fee8ba0-9724-4204-9f8a-472834bb58ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4571f5c-6b0b-42d3-b886-d058fedcb986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4571f5c-6b0b-42d3-b886-d058fedcb986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1527716778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffea315-4e70-4581-8fbc-ee386c793f7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f451e3bcac5247f3a2fd4f0541481cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:39Z,use_quota=True,user_id='e63543f2f2d9469082a99d9eeaf34f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa45d3d-f5f1-4d2f-a87a-3ec2869e64bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa45d3d-f5f1-4d2f-a87a-3ec2869e64bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915b4542-28eb-4792-93ce-07e841766782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915b4542-28eb-4792-93ce-07e841766782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ffea315-4e70-4581-8fbc-ee386c793f7b', 'volume_name': 'volume-7ffea315-4e70-4581-8fbc-ee386c793f7b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351979f7-4103-47e2-9f2d-de2879f5b5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351979f7-4103-47e2-9f2d-de2879f5b5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240d35ac-eb5c-4ecf-8aac-be3473362c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:39 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Volume 7ffea315-4e70-4581-8fbc-ee386c793f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ffea315-4e70-4581-8fbc-ee386c793f7b', 'volume_size': 1} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1527716778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffea315-4e70-4581-8fbc-ee386c793f7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f451e3bcac5247f3a2fd4f0541481cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:39Z,use_quota=True,user_id='e63543f2f2d9469082a99d9eeaf34f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Creating volume 7ffea315-4e70-4581-8fbc-ee386c793f7b {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:39 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:35:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:39 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b 1073741824 Jul 15 18:35:39 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:40 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b 1073741824" returned: 0 in 0.527s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:40 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b Jul 15 18:35:40 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:40 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b" returned: 0 in 0.291s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240d35ac-eb5c-4ecf-8aac-be3473362c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ffea315-4e70-4581-8fbc-ee386c793f7b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ed39be-2a13-442f-88f4-86afcb6c1903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:40 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Volume volume-7ffea315-4e70-4581-8fbc-ee386c793f7b (7ffea315-4e70-4581-8fbc-ee386c793f7b): created successfully Jul 15 18:35:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ed39be-2a13-442f-88f4-86afcb6c1903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Flow 'volume_create_manager' (4fee8ba0-9724-4204-9f8a-472834bb58ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:40 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-01de0c14-bff4-46e0-8347-8fb3ab1cab4f tempest-VolumesListTestJSON-170186896 None] Created volume successfully. Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Flow 'volume_create_manager' (2df3b447-d527-4a4f-9bb9-9d81e4cfd086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17df33e7-9169-4ae8-af49-b88626fe6db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17df33e7-9169-4ae8-af49-b88626fe6db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1675111645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc44c7fc70a46bc8603921009a364a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:41Z,use_quota=True,user_id='26af51f3b1e54daebd0b4173e40a4f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85158d36-6342-43e3-8340-4d5e2668cb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85158d36-6342-43e3-8340-4d5e2668cb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6e2704-331b-482a-b904-f7a75c912a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6e2704-331b-482a-b904-f7a75c912a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5', 'volume_name': 'volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bf7581-6e03-42c4-b2c1-7a2eb0190673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bf7581-6e03-42c4-b2c1-7a2eb0190673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de95ee9a-80fb-4d45-a9e0-304df51929c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:41 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Volume 2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5', 'volume_size': 1} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1675111645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc44c7fc70a46bc8603921009a364a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:41Z,use_quota=True,user_id='26af51f3b1e54daebd0b4173e40a4f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Creating volume 2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:41 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:35:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:41 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 1073741824 Jul 15 18:35:41 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:42 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 1073741824" returned: 0 in 0.638s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:42 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 Jul 15 18:35:42 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Flow 'volume_create_manager' (d4e79e10-aa35-4756-806f-283a85cf201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0241da-8605-4e52-9389-6955ff34afa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0241da-8605-4e52-9389-6955ff34afa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101976648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5157e6b-45d9-4b61-8a33-711ec8eda360,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f451e3bcac5247f3a2fd4f0541481cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:42Z,use_quota=True,user_id='e63543f2f2d9469082a99d9eeaf34f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7241db1-1e98-45e0-a132-e72f000bfd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7241db1-1e98-45e0-a132-e72f000bfd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce926a38-6df9-4e62-a0e8-dd23e1c948f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce926a38-6df9-4e62-a0e8-dd23e1c948f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5157e6b-45d9-4b61-8a33-711ec8eda360', 'volume_name': 'volume-c5157e6b-45d9-4b61-8a33-711ec8eda360', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af93d379-a68d-458d-a3a0-e082ec6315f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af93d379-a68d-458d-a3a0-e082ec6315f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b2fa71-e4d4-439f-af2f-ea3662d0d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:42 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Volume c5157e6b-45d9-4b61-8a33-711ec8eda360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5157e6b-45d9-4b61-8a33-711ec8eda360', 'volume_size': 1} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:42 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5" returned: 0 in 0.308s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101976648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5157e6b-45d9-4b61-8a33-711ec8eda360,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f451e3bcac5247f3a2fd4f0541481cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:42Z,use_quota=True,user_id='e63543f2f2d9469082a99d9eeaf34f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Creating volume c5157e6b-45d9-4b61-8a33-711ec8eda360 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:42 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de95ee9a-80fb-4d45-a9e0-304df51929c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39117e29-71d7-49ce-9903-414e17a46ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:42 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360 1073741824 Jul 15 18:35:42 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:42 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Volume volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 (2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5): created successfully Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39117e29-71d7-49ce-9903-414e17a46ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Flow 'volume_create_manager' (2df3b447-d527-4a4f-9bb9-9d81e4cfd086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:42 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1a7cb512-7c2b-44eb-b413-69a45c6fcfae tempest-AttachVolumeNegativeTest-946525463 None] Created volume successfully. Jul 15 18:35:42 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360 1073741824" returned: 0 in 0.439s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:42 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360 Jul 15 18:35:42 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:43 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360" returned: 0 in 0.421s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b2fa71-e4d4-439f-af2f-ea3662d0d29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5157e6b-45d9-4b61-8a33-711ec8eda360', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f44daea-6946-46fc-8f43-88aa52c1ab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:43 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Volume volume-c5157e6b-45d9-4b61-8a33-711ec8eda360 (c5157e6b-45d9-4b61-8a33-711ec8eda360): created successfully Jul 15 18:35:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f44daea-6946-46fc-8f43-88aa52c1ab22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Flow 'volume_create_manager' (d4e79e10-aa35-4756-806f-283a85cf201a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:43 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e2151078-3324-4560-b311-509600acf055 tempest-VolumesListTestJSON-170186896 None] Created volume successfully. Jul 15 18:35:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-ac6317a2-bdc8-4b98-a13c-127cd581aba4 req-b0dd007f-d0cc-4414-9b27-6f6a8bf47531 tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-ac6317a2-bdc8-4b98-a13c-127cd581aba4 req-b0dd007f-d0cc-4414-9b27-6f6a8bf47531 tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:44 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4f384d-1b24-41db-bc15-b7797e11c6c2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-ac6317a2-bdc8-4b98-a13c-127cd581aba4 req-b0dd007f-d0cc-4414-9b27-6f6a8bf47531 tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:44 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 Jul 15 18:35:44 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:44 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-ac6317a2-bdc8-4b98-a13c-127cd581aba4 req-b0dd007f-d0cc-4414-9b27-6f6a8bf47531 tempest-AttachVolumeNegativeTest-946525463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5" returned: 0 in 0.513s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-ac6317a2-bdc8-4b98-a13c-127cd581aba4 req-b0dd007f-d0cc-4414-9b27-6f6a8bf47531 tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.539s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-ac6317a2-bdc8-4b98-a13c-127cd581aba4 req-b0dd007f-d0cc-4414-9b27-6f6a8bf47531 tempest-AttachVolumeNegativeTest-946525463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffdbd01b-1f27-4818-bfda-5ef0184287ed', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:35:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-ac6317a2-bdc8-4b98-a13c-127cd581aba4 req-b0dd007f-d0cc-4414-9b27-6f6a8bf47531 tempest-AttachVolumeNegativeTest-946525463 None] attachment_update completed successfully. Jul 15 18:35:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Acquiring lock "cinder-c5157e6b-45d9-4b61-8a33-711ec8eda360-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Lock "cinder-c5157e6b-45d9-4b61-8a33-711ec8eda360-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Acquiring lock "cinder-quobyte-c5157e6b-45d9-4b61-8a33-711ec8eda360" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Lock "cinder-quobyte-c5157e6b-45d9-4b61-8a33-711ec8eda360" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:48 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0288c8-7a05-48c2-abc9-801088b43ad4]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:48 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360 Jul 15 18:35:48 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:48 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360" returned: 0 in 0.641s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:48 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360 Jul 15 18:35:48 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:48 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c5157e6b-45d9-4b61-8a33-711ec8eda360" returned: 0 in 0.293s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Lock "cinder-quobyte-c5157e6b-45d9-4b61-8a33-711ec8eda360" released by "delete_volume" :: held 1.009s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:49 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Created reservations ['dd210f46-df02-46d3-93a2-dd5b05ac7b17', '2b554b97-5195-4b01-963f-6aeabdf13122', 'bbc94081-cbfd-4fca-a12f-cf63ed2b023a', '12db3004-b714-4627-b1d2-aa5dddfd66df'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:49 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:35:49 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:49 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.330s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:49 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:49 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Deleted volume successfully. Jul 15 18:35:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e305fce4-a748-4af5-96b6-d5e4ee6943df tempest-VolumesListTestJSON-170186896 None] Lock "cinder-c5157e6b-45d9-4b61-8a33-711ec8eda360-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Acquiring lock "cinder-7ffea315-4e70-4581-8fbc-ee386c793f7b-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Lock "cinder-7ffea315-4e70-4581-8fbc-ee386c793f7b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Acquiring lock "cinder-quobyte-7ffea315-4e70-4581-8fbc-ee386c793f7b" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Lock "cinder-quobyte-7ffea315-4e70-4581-8fbc-ee386c793f7b" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:50 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1068e311-1fd9-4819-acba-25f8ec957519]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:50 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b Jul 15 18:35:50 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:50 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b" returned: 0 in 0.475s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:51 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b Jul 15 18:35:51 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:51 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ffea315-4e70-4581-8fbc-ee386c793f7b" returned: 0 in 0.336s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Lock "cinder-quobyte-7ffea315-4e70-4581-8fbc-ee386c793f7b" released by "delete_volume" :: held 0.886s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Created reservations ['9dbf9970-5754-40ed-adcd-609dad8e9fbd', 'c3481ad4-e034-406d-9ee9-f54047258d9d', 'cc5c10e3-4850-4c0c-86f9-00c8128c939e', '3e7dddb0-528c-4f61-b1c3-7d1c62f8aa5b'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:51 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:35:51 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:51 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.288s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:51 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Deleted volume successfully. Jul 15 18:35:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cb47774d-46ae-4153-9bdd-0b44bff2beb2 tempest-VolumesListTestJSON-170186896 None] Lock "cinder-7ffea315-4e70-4581-8fbc-ee386c793f7b-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Acquiring lock "cinder-f49b2050-dd24-44f6-8a68-36ed55ea5bc7-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Lock "cinder-f49b2050-dd24-44f6-8a68-36ed55ea5bc7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Acquiring lock "cinder-quobyte-f49b2050-dd24-44f6-8a68-36ed55ea5bc7" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Lock "cinder-quobyte-f49b2050-dd24-44f6-8a68-36ed55ea5bc7" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:52 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9299647-421c-48f6-a488-4855bdc2997f]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:52 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7 Jul 15 18:35:52 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:53 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7" returned: 0 in 0.521s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:53 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7 Jul 15 18:35:53 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:53 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f49b2050-dd24-44f6-8a68-36ed55ea5bc7" returned: 0 in 0.404s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Lock "cinder-quobyte-f49b2050-dd24-44f6-8a68-36ed55ea5bc7" released by "delete_volume" :: held 0.999s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Created reservations ['ef383681-b457-4828-af53-244f21bbf572', 'f108c26f-e57c-4243-ae8d-c5803cab6f57', '1a7a3802-b81d-45d4-ad5b-da847155e3c1', 'a8fc7fd2-e8b8-4d5f-b244-66c6aab143af'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:54 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:35:54 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:54 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.414s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:54 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Deleted volume successfully. Jul 15 18:35:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cde702fb-b20d-4780-b7d9-b6a97ef6bc7d tempest-VolumesListTestJSON-170186896 None] Lock "cinder-f49b2050-dd24-44f6-8a68-36ed55ea5bc7-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:02 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-310cfbab-c103-4c0a-849c-ea870286a699 req-aa6a6b79-66f1-4d00-8824-91c293e62fff tempest-AttachVolumeTestJSON-1801034467 None] Terminate volume connection completed successfully. Jul 15 18:36:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-310cfbab-c103-4c0a-849c-ea870286a699 req-aa6a6b79-66f1-4d00-8824-91c293e62fff tempest-AttachVolumeTestJSON-1801034467 None] Deleting attachment 230d696b-b431-467c-8478-d03e9586c843. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:36:12 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=30,cinder:SELECT=33,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:36:12 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=45,cinder:INSERT=7,cinder:DELETE=3,cinder:SELECT=25 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (df4b24c6-8ff8-48fc-b2e7-df4399cb220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5189c243-c171-4404-9744-33b7ab995ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5189c243-c171-4404-9744-33b7ab995ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1909399460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f880366-a027-4feb-b915-5e1d7b5dce7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:28Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2e33fb-f246-4e2e-b121-8b96ca083e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2e33fb-f246-4e2e-b121-8b96ca083e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f773e15-dfac-4d50-a599-6cdd47dcb454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f773e15-dfac-4d50-a599-6cdd47dcb454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f880366-a027-4feb-b915-5e1d7b5dce7e', 'volume_name': 'volume-2f880366-a027-4feb-b915-5e1d7b5dce7e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7a4dfa-c650-4818-a2f9-6cd5c0e2c98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7a4dfa-c650-4818-a2f9-6cd5c0e2c98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcb10a5-5aec-42d2-968e-e559c1219877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:27 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Volume 2f880366-a027-4feb-b915-5e1d7b5dce7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f880366-a027-4feb-b915-5e1d7b5dce7e', 'volume_size': 1} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1909399460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f880366-a027-4feb-b915-5e1d7b5dce7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:28Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Creating volume 2f880366-a027-4feb-b915-5e1d7b5dce7e {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:27 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:36:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:27 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e 1073741824 Jul 15 18:36:27 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:28 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e 1073741824" returned: 0 in 1.255s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:29 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e Jul 15 18:36:29 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:29 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e" returned: 0 in 0.545s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcb10a5-5aec-42d2-968e-e559c1219877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f880366-a027-4feb-b915-5e1d7b5dce7e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369c570e-1197-48df-bcd7-1a536f24f9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:29 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Volume volume-2f880366-a027-4feb-b915-5e1d7b5dce7e (2f880366-a027-4feb-b915-5e1d7b5dce7e): created successfully Jul 15 18:36:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369c570e-1197-48df-bcd7-1a536f24f9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (df4b24c6-8ff8-48fc-b2e7-df4399cb220b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:29 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9e8528be-36b2-4fa5-abd6-1c119fd2cad3 tempest-VolumesActionsTest-232047804 None] Created volume successfully. Jul 15 18:36:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-82712f9b-82ff-4e60-895a-288285af6065 tempest-VolumesActionsTest-232047804 None] Acquiring lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e" by "attach_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-82712f9b-82ff-4e60-895a-288285af6065 tempest-VolumesActionsTest-232047804 None] Lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e" acquired by "attach_volume" :: waited 0.060s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-82712f9b-82ff-4e60-895a-288285af6065 tempest-VolumesActionsTest-232047804 None] Attaching volume 2f880366-a027-4feb-b915-5e1d7b5dce7e to instance 8b8bcd25-9a1b-41da-834b-8236c6568685 at mountpoint /dev/vdb on host None. Jul 15 18:36:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-82712f9b-82ff-4e60-895a-288285af6065 tempest-VolumesActionsTest-232047804 None] Attach volume completed successfully. Jul 15 18:36:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-82712f9b-82ff-4e60-895a-288285af6065 tempest-VolumesActionsTest-232047804 None] Lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e" released by "attach_volume" :: held 0.396s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-95f15b7e-9679-4bd8-9cac-9942f1faa63b tempest-VolumesActionsTest-109175987 None] Terminate volume connection completed successfully. Jul 15 18:36:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-95f15b7e-9679-4bd8-9cac-9942f1faa63b tempest-VolumesActionsTest-109175987 None] Acquiring lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e-detach_volume" by "detach_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-95f15b7e-9679-4bd8-9cac-9942f1faa63b tempest-VolumesActionsTest-109175987 None] Lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-95f15b7e-9679-4bd8-9cac-9942f1faa63b tempest-VolumesActionsTest-109175987 None] Detaching volume 2f880366-a027-4feb-b915-5e1d7b5dce7e from instance 8b8bcd25-9a1b-41da-834b-8236c6568685. Jul 15 18:36:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-95f15b7e-9679-4bd8-9cac-9942f1faa63b tempest-VolumesActionsTest-109175987 None] Detach volume completed successfully. Jul 15 18:36:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-95f15b7e-9679-4bd8-9cac-9942f1faa63b tempest-VolumesActionsTest-109175987 None] Lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e-detach_volume" released by "detach_volume" :: held 0.265s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-37eb97b5-0243-4a32-a43d-adc9beca30dc tempest-VolumesActionsTest-232047804 None] Acquiring lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e-detach_volume" by "detach_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-37eb97b5-0243-4a32-a43d-adc9beca30dc tempest-VolumesActionsTest-232047804 None] Lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:34 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-37eb97b5-0243-4a32-a43d-adc9beca30dc tempest-VolumesActionsTest-232047804 None] Volume detach called, but volume not attached. Jul 15 18:36:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-37eb97b5-0243-4a32-a43d-adc9beca30dc tempest-VolumesActionsTest-232047804 None] Lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Acquiring lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Acquiring lock "cinder-quobyte-2f880366-a027-4feb-b915-5e1d7b5dce7e" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Lock "cinder-quobyte-2f880366-a027-4feb-b915-5e1d7b5dce7e" acquired by "delete_volume" :: waited 0.044s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a536eff-13be-49a3-af4a-afa69ed17b24]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:35 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e Jul 15 18:36:35 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:35 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:36:35 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:35 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e" returned: 0 in 0.751s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:35 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e Jul 15 18:36:35 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:35 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.802s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:36:36 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f880366-a027-4feb-b915-5e1d7b5dce7e" returned: 0 in 0.547s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Lock "cinder-quobyte-2f880366-a027-4feb-b915-5e1d7b5dce7e" released by "delete_volume" :: held 1.390s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Created reservations ['e7507011-c9ce-405b-abf5-aa2fd1822f9b', '9d9b16de-4fd6-4b72-9efb-e4675ff20b94', '9195c2b5-bb4e-47a8-90c6-a9957f8958bd', '20a1ca3b-c28a-4734-9a9f-cf965e1bd100'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:36 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:36:36 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:37 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.600s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:37 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Deleted volume successfully. Jul 15 18:36:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a1149bac-1391-4092-868d-aac374ea627d tempest-VolumesActionsTest-232047804 None] Lock "cinder-2f880366-a027-4feb-b915-5e1d7b5dce7e-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-a899fd40-98c8-4b12-871b-9578552d65f2 req-df258c67-ae73-4647-a9a7-7abc4b42fb56 tempest-AttachVolumeNegativeTest-946525463 None] Terminate volume connection completed successfully. Jul 15 18:36:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-a899fd40-98c8-4b12-871b-9578552d65f2 req-df258c67-ae73-4647-a9a7-7abc4b42fb56 tempest-AttachVolumeNegativeTest-946525463 None] Deleting attachment ffdbd01b-1f27-4818-bfda-5ef0184287ed. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Flow 'volume_create_manager' (91e8072c-d343-43f0-b734-a9c882a8f3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff0b365-57d5-4331-a744-b4e3ad52b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff0b365-57d5-4331-a744-b4e3ad52b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-491552804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e356fb58-7126-4473-a0a5-6096fc5cb5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d64aba439324dcfbc03ea94f0ca2e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:39Z,use_quota=True,user_id='d7c074886a554a94a0e0a705266116e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35f10f0-494a-420e-8c47-af35f4732651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35f10f0-494a-420e-8c47-af35f4732651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb97b677-ef1e-4ae6-af8d-e8b8e65f4b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb97b677-ef1e-4ae6-af8d-e8b8e65f4b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e356fb58-7126-4473-a0a5-6096fc5cb5bb', 'volume_name': 'volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90de09b7-68e0-480b-9f44-2c6f343828a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90de09b7-68e0-480b-9f44-2c6f343828a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed89059-96ad-416f-afd7-564db3b8c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:39 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Volume e356fb58-7126-4473-a0a5-6096fc5cb5bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb', 'volume_size': 1} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-491552804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e356fb58-7126-4473-a0a5-6096fc5cb5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d64aba439324dcfbc03ea94f0ca2e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:39Z,use_quota=True,user_id='d7c074886a554a94a0e0a705266116e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Creating volume e356fb58-7126-4473-a0a5-6096fc5cb5bb {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:39 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:36:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:39 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb 1073741824 Jul 15 18:36:39 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Flow 'volume_create_manager' (2631a27a-1f63-44a9-8e92-ccf10edced50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906de604-b73d-431e-ae3d-0a3032d1cf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906de604-b73d-431e-ae3d-0a3032d1cf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2036063855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572c8a75-7769-4f90-bf6e-5310649eecfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d64aba439324dcfbc03ea94f0ca2e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:40Z,use_quota=True,user_id='d7c074886a554a94a0e0a705266116e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:40 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af3956a-fb11-4b80-b984-852bb9768b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af3956a-fb11-4b80-b984-852bb9768b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44dd22c-9ac8-4ce0-8245-158cef10ff0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44dd22c-9ac8-4ce0-8245-158cef10ff0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572c8a75-7769-4f90-bf6e-5310649eecfb', 'volume_name': 'volume-572c8a75-7769-4f90-bf6e-5310649eecfb', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbfce6c-dc54-4689-a822-e98421a1f364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbfce6c-dc54-4689-a822-e98421a1f364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a220dfb-24b9-483f-ad2a-551a7aaa53b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:40 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Volume 572c8a75-7769-4f90-bf6e-5310649eecfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572c8a75-7769-4f90-bf6e-5310649eecfb', 'volume_size': 1} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb 1073741824" returned: 0 in 1.145s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:41 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb Jul 15 18:36:41 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:41 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb" returned: 0 in 0.417s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2036063855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572c8a75-7769-4f90-bf6e-5310649eecfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d64aba439324dcfbc03ea94f0ca2e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:40Z,use_quota=True,user_id='d7c074886a554a94a0e0a705266116e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Creating volume 572c8a75-7769-4f90-bf6e-5310649eecfb {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:41 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed89059-96ad-416f-afd7-564db3b8c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:41 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb 1073741824 Jul 15 18:36:41 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bae33b-8651-468e-9885-1a73c815e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:41 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Volume volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb (e356fb58-7126-4473-a0a5-6096fc5cb5bb): created successfully Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bae33b-8651-468e-9885-1a73c815e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Flow 'volume_create_manager' (91e8072c-d343-43f0-b734-a9c882a8f3d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:41 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-34032579-497a-4afc-8cf8-28119ff5335d tempest-TestServerVolumeAttachmentScenario-211886262 None] Created volume successfully. Jul 15 18:36:42 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb 1073741824" returned: 0 in 0.691s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:42 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb Jul 15 18:36:42 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:42 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb" returned: 0 in 0.561s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a220dfb-24b9-483f-ad2a-551a7aaa53b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572c8a75-7769-4f90-bf6e-5310649eecfb', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b558bbee-552d-423c-b8dd-437c5ec018d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:42 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Volume volume-572c8a75-7769-4f90-bf6e-5310649eecfb (572c8a75-7769-4f90-bf6e-5310649eecfb): created successfully Jul 15 18:36:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b558bbee-552d-423c-b8dd-437c5ec018d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Flow 'volume_create_manager' (2631a27a-1f63-44a9-8e92-ccf10edced50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:42 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-11451801-749e-4ced-830f-3179bbdfeee3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Created volume successfully. Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (2769fc25-f222-454a-bae2-454335997829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72166cb1-8f2c-4615-a59a-158d2a9dbca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72166cb1-8f2c-4615-a59a-158d2a9dbca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1997370956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a65402-f878-4be5-8d2c-315f6563146d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:43Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388e4c65-1473-44db-83f7-c006834ccec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388e4c65-1473-44db-83f7-c006834ccec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6bcbbe-a8a2-4631-934c-55fc1e9998f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6bcbbe-a8a2-4631-934c-55fc1e9998f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a65402-f878-4be5-8d2c-315f6563146d', 'volume_name': 'volume-e8a65402-f878-4be5-8d2c-315f6563146d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4d193f-3592-42d1-91af-12fcd934c062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4d193f-3592-42d1-91af-12fcd934c062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e403a10-0134-443c-906f-10760016e100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:43 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Volume e8a65402-f878-4be5-8d2c-315f6563146d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a65402-f878-4be5-8d2c-315f6563146d', 'volume_size': 1} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1997370956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a65402-f878-4be5-8d2c-315f6563146d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:43Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Creating volume e8a65402-f878-4be5-8d2c-315f6563146d {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:43 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:36:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:43 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d 1073741824 Jul 15 18:36:43 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:44 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d 1073741824" returned: 0 in 0.644s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:44 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d Jul 15 18:36:44 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:44 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d" returned: 0 in 0.529s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e403a10-0134-443c-906f-10760016e100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a65402-f878-4be5-8d2c-315f6563146d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d0dfcf-88c2-45bd-8e4f-368a4001ac26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:44 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Volume volume-e8a65402-f878-4be5-8d2c-315f6563146d (e8a65402-f878-4be5-8d2c-315f6563146d): created successfully Jul 15 18:36:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d0dfcf-88c2-45bd-8e4f-368a4001ac26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (2769fc25-f222-454a-bae2-454335997829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:44 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-810dd722-1e65-46d9-a772-e64343a21457 tempest-VolumesActionsTest-232047804 None] Created volume successfully. Jul 15 18:36:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Acquiring lock "cinder-e8a65402-f878-4be5-8d2c-315f6563146d-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Lock "cinder-e8a65402-f878-4be5-8d2c-315f6563146d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Acquiring lock "cinder-quobyte-e8a65402-f878-4be5-8d2c-315f6563146d" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Lock "cinder-quobyte-e8a65402-f878-4be5-8d2c-315f6563146d" acquired by "delete_volume" :: waited 0.033s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:45 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7834aa4-81a8-4d7d-8cd1-29b3c85733ac]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:46 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d Jul 15 18:36:46 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:46 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d" returned: 0 in 0.540s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:46 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d Jul 15 18:36:46 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:46 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e8a65402-f878-4be5-8d2c-315f6563146d" returned: 0 in 0.443s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Lock "cinder-quobyte-e8a65402-f878-4be5-8d2c-315f6563146d" released by "delete_volume" :: held 1.061s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:47 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Created reservations ['80c55a40-9915-44ed-b6e0-ae6a50ecb988', '3690ae82-1080-45f3-a87c-70c5a45da5a3', '40a4d564-4965-469c-b3c6-cbfd31b0f329', '78e44e98-25a1-410a-ac93-36f8d61cbfaa'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:47 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:36:47 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:47 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.365s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:47 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:47 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Deleted volume successfully. Jul 15 18:36:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3ceeb25d-e816-4ac4-b6ad-881d1c29ab91 tempest-VolumesActionsTest-109175987 None] Lock "cinder-e8a65402-f878-4be5-8d2c-315f6563146d-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (f620b17c-5b83-4f75-b708-8c38ee6d40dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b043d144-04fe-4c54-b00f-cc066e8e4913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b043d144-04fe-4c54-b00f-cc066e8e4913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1944340351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871cd41a-9708-4592-8aec-17bb1d8eafc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:49Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1726377a-4375-4e34-bf4b-af82d82251b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1726377a-4375-4e34-bf4b-af82d82251b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c6952c-2607-4776-ada4-98b2dc0c7699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c6952c-2607-4776-ada4-98b2dc0c7699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871cd41a-9708-4592-8aec-17bb1d8eafc1', 'volume_name': 'volume-871cd41a-9708-4592-8aec-17bb1d8eafc1', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b135e1fa-c50e-429c-bc63-448f4fdb0fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b135e1fa-c50e-429c-bc63-448f4fdb0fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4145cef1-db7c-4050-a2a9-8472bab10d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:49 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Volume 871cd41a-9708-4592-8aec-17bb1d8eafc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871cd41a-9708-4592-8aec-17bb1d8eafc1', 'volume_size': 1} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1944340351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871cd41a-9708-4592-8aec-17bb1d8eafc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:49Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Creating volume 871cd41a-9708-4592-8aec-17bb1d8eafc1 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:49 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:49 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1 1073741824 Jul 15 18:36:49 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:49 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1 1073741824" returned: 0 in 0.610s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:49 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1 Jul 15 18:36:49 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:50 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1" returned: 0 in 0.310s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4145cef1-db7c-4050-a2a9-8472bab10d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871cd41a-9708-4592-8aec-17bb1d8eafc1', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8acb5a-23d6-42ba-972f-aef0ba242269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:50 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Volume volume-871cd41a-9708-4592-8aec-17bb1d8eafc1 (871cd41a-9708-4592-8aec-17bb1d8eafc1): created successfully Jul 15 18:36:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8acb5a-23d6-42ba-972f-aef0ba242269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (f620b17c-5b83-4f75-b708-8c38ee6d40dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-667d7191-6dd2-46be-8bdc-d0540ca25856 tempest-VolumesActionsTest-232047804 None] Created volume successfully. Jul 15 18:36:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Acquiring lock "cinder-871cd41a-9708-4592-8aec-17bb1d8eafc1-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Lock "cinder-871cd41a-9708-4592-8aec-17bb1d8eafc1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Acquiring lock "cinder-quobyte-871cd41a-9708-4592-8aec-17bb1d8eafc1" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Lock "cinder-quobyte-871cd41a-9708-4592-8aec-17bb1d8eafc1" acquired by "delete_volume" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3cd538-fb84-4c91-97c5-204092cb0f3a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:51 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1 Jul 15 18:36:51 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:51 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1" returned: 0 in 0.488s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:51 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1 Jul 15 18:36:51 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:52 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-871cd41a-9708-4592-8aec-17bb1d8eafc1" returned: 0 in 0.343s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Lock "cinder-quobyte-871cd41a-9708-4592-8aec-17bb1d8eafc1" released by "delete_volume" :: held 0.890s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:52 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Created reservations ['261b311e-6df2-47de-91de-e4dcf8bd9c14', '19ce9beb-6406-4231-b2a5-4cfb2bf48ba8', '17c178de-a307-4061-b928-f1aa20a0a22d', '24c201e9-d712-4d89-a1f4-5934721db58c'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:52 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:52 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:52 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:36:52 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:53 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.569s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:53 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Deleted volume successfully. Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-79203310-693c-4aae-9476-73eee7df5f94 tempest-VolumesActionsTest-109175987 None] Lock "cinder-871cd41a-9708-4592-8aec-17bb1d8eafc1-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (23797820-3047-48c1-b816-47319d0ea3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1867ff6c-b6d6-4db4-968c-7242707aa843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1867ff6c-b6d6-4db4-968c-7242707aa843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-462833945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed072f4-022a-43b1-b2fb-bca0844b3886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:54Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424ab940-6ff6-462d-8f88-bee620c03935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424ab940-6ff6-462d-8f88-bee620c03935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b83f5c-79e5-49be-8214-09466b2f9a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b83f5c-79e5-49be-8214-09466b2f9a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed072f4-022a-43b1-b2fb-bca0844b3886', 'volume_name': 'volume-2ed072f4-022a-43b1-b2fb-bca0844b3886', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccf4301-de76-4053-a803-a497bf23bd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccf4301-de76-4053-a803-a497bf23bd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34650fc-5284-45d2-9890-28f0841f6317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:53 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Volume 2ed072f4-022a-43b1-b2fb-bca0844b3886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed072f4-022a-43b1-b2fb-bca0844b3886', 'volume_size': 1} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-462833945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed072f4-022a-43b1-b2fb-bca0844b3886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:54Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Creating volume 2ed072f4-022a-43b1-b2fb-bca0844b3886 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:53 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:36:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:54 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886 1073741824 Jul 15 18:36:54 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:55 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886 1073741824" returned: 0 in 1.249s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:55 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886 Jul 15 18:36:55 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:55 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886" returned: 0 in 0.424s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34650fc-5284-45d2-9890-28f0841f6317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed072f4-022a-43b1-b2fb-bca0844b3886', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0570e24e-06ff-4c10-bbbc-84eb2edf8967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:55 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Volume volume-2ed072f4-022a-43b1-b2fb-bca0844b3886 (2ed072f4-022a-43b1-b2fb-bca0844b3886): created successfully Jul 15 18:36:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0570e24e-06ff-4c10-bbbc-84eb2edf8967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (23797820-3047-48c1-b816-47319d0ea3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:55 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f250eef9-c003-44ce-be58-b847ad20ba84 tempest-VolumesActionsTest-232047804 None] Created volume successfully. Jul 15 18:36:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Acquiring lock "cinder-2ed072f4-022a-43b1-b2fb-bca0844b3886-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Lock "cinder-2ed072f4-022a-43b1-b2fb-bca0844b3886-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Acquiring lock "cinder-quobyte-2ed072f4-022a-43b1-b2fb-bca0844b3886" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Lock "cinder-quobyte-2ed072f4-022a-43b1-b2fb-bca0844b3886" acquired by "delete_volume" :: waited 0.057s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:57 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b07932c-f5f7-4e7f-a8f8-869c3c204e1d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:58 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886 Jul 15 18:36:58 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:58 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886" returned: 0 in 0.846s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:58 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886 Jul 15 18:36:58 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:59 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2ed072f4-022a-43b1-b2fb-bca0844b3886" returned: 0 in 0.478s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Lock "cinder-quobyte-2ed072f4-022a-43b1-b2fb-bca0844b3886" released by "delete_volume" :: held 1.454s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:59 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Created reservations ['ca84775d-3f0e-490d-ab68-76470b79d10e', 'e540f80a-165b-471a-a7dd-743a4b49af02', 'b37cf671-37c6-4b12-95fd-dd917e71ede4', 'b45f2b99-ba7e-406a-a2c8-dfb37d59cc9e'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:59 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:36:59 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:00 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.712s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:00 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Deleted volume successfully. Jul 15 18:37:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6367d7f7-795e-4c5d-b589-a96662297b20 tempest-VolumesActionsTest-109175987 None] Lock "cinder-2ed072f4-022a-43b1-b2fb-bca0844b3886-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (7ca3d7ab-fca0-441a-bf87-74d407a95d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c004dd-6c76-453e-83f0-43eefae5fa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c004dd-6c76-453e-83f0-43eefae5fa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-487080711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a1abeb-23a2-4bf8-9792-ef286170f3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:01Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd835d8-7e43-49e9-86cc-9b4bd1293aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd835d8-7e43-49e9-86cc-9b4bd1293aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f0bff3-ab90-4b77-a6e8-d6d6de5faa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f0bff3-ab90-4b77-a6e8-d6d6de5faa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28a1abeb-23a2-4bf8-9792-ef286170f3a4', 'volume_name': 'volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba7b63d-8fd0-4fad-9210-dafdac2fef65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba7b63d-8fd0-4fad-9210-dafdac2fef65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7b33fd-ff48-4369-9cec-e86b67eb9307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:01 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Volume 28a1abeb-23a2-4bf8-9792-ef286170f3a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4', 'volume_size': 1} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-487080711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a1abeb-23a2-4bf8-9792-ef286170f3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:01Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Creating volume 28a1abeb-23a2-4bf8-9792-ef286170f3a4 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:01 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:37:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:01 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4 1073741824 Jul 15 18:37:01 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:02 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4 1073741824" returned: 0 in 0.671s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:02 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4 Jul 15 18:37:02 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:02 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4" returned: 0 in 0.726s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7b33fd-ff48-4369-9cec-e86b67eb9307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65f4bf3-68db-4e49-8501-2017fae558f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:03 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Volume volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4 (28a1abeb-23a2-4bf8-9792-ef286170f3a4): created successfully Jul 15 18:37:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65f4bf3-68db-4e49-8501-2017fae558f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (7ca3d7ab-fca0-441a-bf87-74d407a95d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:03 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-91e770e2-e81c-4764-93b7-d92999a56237 tempest-VolumesActionsTest-232047804 None] Created volume successfully. Jul 15 18:37:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Acquiring lock "cinder-28a1abeb-23a2-4bf8-9792-ef286170f3a4-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Lock "cinder-28a1abeb-23a2-4bf8-9792-ef286170f3a4-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Acquiring lock "cinder-quobyte-28a1abeb-23a2-4bf8-9792-ef286170f3a4" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Lock "cinder-quobyte-28a1abeb-23a2-4bf8-9792-ef286170f3a4" acquired by "delete_volume" :: waited 0.048s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:04 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa66980e-370a-4a96-b2c5-1efd2604af05]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:04 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4 Jul 15 18:37:04 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:05 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4" returned: 0 in 1.105s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:05 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4 Jul 15 18:37:05 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:06 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-28a1abeb-23a2-4bf8-9792-ef286170f3a4" returned: 0 in 0.522s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Lock "cinder-quobyte-28a1abeb-23a2-4bf8-9792-ef286170f3a4" released by "delete_volume" :: held 1.737s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:06 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Created reservations ['9d0565ea-ed4b-4942-88eb-03d6afe9da93', '429fc0fe-f68c-4aa9-ae3c-e838e2879729', 'a4452c5e-d0e2-4a01-b0c1-ff08bd7ed132', '9b67e2d6-0f1a-4c67-9cd1-c3a6d933aa86'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:06 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:37:06 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:07 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.687s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:07 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:07 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Deleted volume successfully. Jul 15 18:37:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cc38c7b4-5111-4051-9df0-05366d538b26 tempest-VolumesActionsTest-109175987 None] Lock "cinder-28a1abeb-23a2-4bf8-9792-ef286170f3a4-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (0493106e-08a4-43aa-b4c0-9e613e4490f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d473a08a-c405-48f8-b036-394c16e36029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d473a08a-c405-48f8-b036-394c16e36029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1653473321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d280e3bc-3d21-4ea6-9865-7aced125acf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:08Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885eb2c7-ebc6-421d-ac19-ec6ca292269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885eb2c7-ebc6-421d-ac19-ec6ca292269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d980b0c-3243-4caa-b3df-51a0253e3590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d980b0c-3243-4caa-b3df-51a0253e3590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd280e3bc-3d21-4ea6-9865-7aced125acf8', 'volume_name': 'volume-d280e3bc-3d21-4ea6-9865-7aced125acf8', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c95ce04-f67a-4d99-a7cb-edd23f198ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c95ce04-f67a-4d99-a7cb-edd23f198ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64ed2ca-c1ef-4feb-916a-2e19bd260367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:08 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Volume d280e3bc-3d21-4ea6-9865-7aced125acf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d280e3bc-3d21-4ea6-9865-7aced125acf8', 'volume_size': 1} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1653473321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d280e3bc-3d21-4ea6-9865-7aced125acf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be14d8ed10641d7af1e723c7ca4486b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:08Z,use_quota=True,user_id='cef6b90c761d49549921a62c7d9db8f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Creating volume d280e3bc-3d21-4ea6-9865-7aced125acf8 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:08 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:37:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:08 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8 1073741824 Jul 15 18:37:08 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:09 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8 1073741824" returned: 0 in 1.633s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:10 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8 Jul 15 18:37:10 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:10 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8" returned: 0 in 0.867s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.672s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64ed2ca-c1ef-4feb-916a-2e19bd260367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d280e3bc-3d21-4ea6-9865-7aced125acf8', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89305e6f-bfc5-47fb-a511-773b101417a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:11 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Volume volume-d280e3bc-3d21-4ea6-9865-7aced125acf8 (d280e3bc-3d21-4ea6-9865-7aced125acf8): created successfully Jul 15 18:37:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89305e6f-bfc5-47fb-a511-773b101417a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Flow 'volume_create_manager' (0493106e-08a4-43aa-b4c0-9e613e4490f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:11 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c6df362b-3eed-41e7-8d18-6511ace81307 tempest-VolumesActionsTest-232047804 None] Created volume successfully. Jul 15 18:37:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Acquiring lock "cinder-d280e3bc-3d21-4ea6-9865-7aced125acf8-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Lock "cinder-d280e3bc-3d21-4ea6-9865-7aced125acf8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Acquiring lock "cinder-quobyte-d280e3bc-3d21-4ea6-9865-7aced125acf8" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Lock "cinder-quobyte-d280e3bc-3d21-4ea6-9865-7aced125acf8" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a96fbb7-a142-423c-b22d-916ba4a5de7b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:13 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8 Jul 15 18:37:13 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:13 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8" returned: 0 in 0.565s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:13 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8 Jul 15 18:37:13 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:14 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d280e3bc-3d21-4ea6-9865-7aced125acf8" returned: 0 in 0.390s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Lock "cinder-quobyte-d280e3bc-3d21-4ea6-9865-7aced125acf8" released by "delete_volume" :: held 1.026s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:14 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Created reservations ['a8eaf5dd-7835-4153-b83d-058ac3b88dce', '51ecff79-8ac2-410f-9d4d-60ddbc0a9c6c', '008b5b90-0ec6-4c61-9a71-12d77602985f', '39d3037b-ca55-468b-bd56-bffd2086f514'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:14 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:37:14 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:15 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.529s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:15 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:15 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Deleted volume successfully. Jul 15 18:37:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c5199657-c18e-4b9e-9d93-9e7190103578 tempest-VolumesActionsTest-232047804 None] Lock "cinder-d280e3bc-3d21-4ea6-9865-7aced125acf8-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:22 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=53,cinder:INSERT=16,cinder:UPDATE=80,cinder:DELETE=7 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:37:22 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=72,cinder:SELECT=59,cinder:DELETE=7,cinder:INSERT=18 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:37:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-e30a9add-521d-4af9-b07e-26fcf5c9467d req-03499318-1901-47d3-a9f6-18c59cebac0e tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-e30a9add-521d-4af9-b07e-26fcf5c9467d req-03499318-1901-47d3-a9f6-18c59cebac0e tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:22 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1a5f9e-8d9c-41e2-8fff-4d28eaec45f2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-e30a9add-521d-4af9-b07e-26fcf5c9467d req-03499318-1901-47d3-a9f6-18c59cebac0e tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:22 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb Jul 15 18:37:22 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:23 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-e30a9add-521d-4af9-b07e-26fcf5c9467d req-03499318-1901-47d3-a9f6-18c59cebac0e tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb" returned: 0 in 0.419s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-e30a9add-521d-4af9-b07e-26fcf5c9467d req-03499318-1901-47d3-a9f6-18c59cebac0e tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.447s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-e30a9add-521d-4af9-b07e-26fcf5c9467d req-03499318-1901-47d3-a9f6-18c59cebac0e tempest-TestServerVolumeAttachmentScenario-211886262 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fc9e954-9929-4dd7-bf5a-002fa85b1ede', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:37:23 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-e30a9add-521d-4af9-b07e-26fcf5c9467d req-03499318-1901-47d3-a9f6-18c59cebac0e tempest-TestServerVolumeAttachmentScenario-211886262 None] attachment_update completed successfully. Jul 15 18:37:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-da5a2f7e-0984-47af-a2b9-aa0b781e9bb3 req-c288cfb0-592f-4e40-af02-5d33117edf6f tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-da5a2f7e-0984-47af-a2b9-aa0b781e9bb3 req-c288cfb0-592f-4e40-af02-5d33117edf6f tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:28 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bab56b8-2ccc-4e5c-8a8d-74841fd1b6b1]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-da5a2f7e-0984-47af-a2b9-aa0b781e9bb3 req-c288cfb0-592f-4e40-af02-5d33117edf6f tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:29 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb Jul 15 18:37:29 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:29 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-da5a2f7e-0984-47af-a2b9-aa0b781e9bb3 req-c288cfb0-592f-4e40-af02-5d33117edf6f tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb" returned: 0 in 0.450s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-da5a2f7e-0984-47af-a2b9-aa0b781e9bb3 req-c288cfb0-592f-4e40-af02-5d33117edf6f tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.467s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-da5a2f7e-0984-47af-a2b9-aa0b781e9bb3 req-c288cfb0-592f-4e40-af02-5d33117edf6f tempest-TestServerVolumeAttachmentScenario-211886262 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-572c8a75-7769-4f90-bf6e-5310649eecfb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9320ecd7-d46e-4638-8fa1-5f7dd79a32cd', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:37:29 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-da5a2f7e-0984-47af-a2b9-aa0b781e9bb3 req-c288cfb0-592f-4e40-af02-5d33117edf6f tempest-TestServerVolumeAttachmentScenario-211886262 None] attachment_update completed successfully. Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Flow 'volume_create_manager' (64d69178-de13-4d49-ae0c-3178303b38a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc3c5be-2443-414a-8d72-59b93c643969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc3c5be-2443-414a-8d72-59b93c643969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1631329138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223267fd-0bd8-475c-8507-a6591e7ae1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9085ecccde2d44d7af021f9b4268d3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:30Z,use_quota=True,user_id='99819dbad1154f9181994c453f4a6cd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8864f5fb-2e6a-496e-a28f-3667e43e738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8864f5fb-2e6a-496e-a28f-3667e43e738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d876497c-d470-44bd-bca2-9cc87db44dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d876497c-d470-44bd-bca2-9cc87db44dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223267fd-0bd8-475c-8507-a6591e7ae1e8', 'volume_name': 'volume-223267fd-0bd8-475c-8507-a6591e7ae1e8', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec5b765-b595-4811-b710-b81dd413afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec5b765-b595-4811-b710-b81dd413afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2eaf846-88e1-460f-b2dd-887fcf7fba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:30 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Volume 223267fd-0bd8-475c-8507-a6591e7ae1e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223267fd-0bd8-475c-8507-a6591e7ae1e8', 'volume_size': 1} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1631329138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223267fd-0bd8-475c-8507-a6591e7ae1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9085ecccde2d44d7af021f9b4268d3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:30Z,use_quota=True,user_id='99819dbad1154f9181994c453f4a6cd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Creating volume 223267fd-0bd8-475c-8507-a6591e7ae1e8 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:30 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:30 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 1073741824 Jul 15 18:37:30 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:30 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 1073741824" returned: 0 in 0.468s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:30 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 Jul 15 18:37:30 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:31 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8" returned: 0 in 0.313s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2eaf846-88e1-460f-b2dd-887fcf7fba27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223267fd-0bd8-475c-8507-a6591e7ae1e8', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279ebee5-3f48-4224-b478-3fa1f9e1868e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:31 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Volume volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 (223267fd-0bd8-475c-8507-a6591e7ae1e8): created successfully Jul 15 18:37:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279ebee5-3f48-4224-b478-3fa1f9e1868e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Flow 'volume_create_manager' (64d69178-de13-4d49-ae0c-3178303b38a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a663ddd9-6cf6-44cd-8e8b-10cb55285976 tempest-SnapshotMetadataTestJSON-1437214964 None] Created volume successfully. Jul 15 18:37:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-398ab8a0-ce09-4132-9dac-38c6b68a8456 req-8d4c096a-6114-4169-b2e6-0766a9c8eaf0 tempest-TestServerVolumeAttachmentScenario-211886262 None] Terminate volume connection completed successfully. Jul 15 18:37:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-398ab8a0-ce09-4132-9dac-38c6b68a8456 req-8d4c096a-6114-4169-b2e6-0766a9c8eaf0 tempest-TestServerVolumeAttachmentScenario-211886262 None] Deleting attachment 9320ecd7-d46e-4638-8fa1-5f7dd79a32cd. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Flow 'volume_create_manager' (3e6db0b5-2305-436f-8ece-b5af08e4690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e9fd1a-8989-40c7-a15e-6999bfffa01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e9fd1a-8989-40c7-a15e-6999bfffa01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1257033813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff39ac7f-2601-42db-a595-d8fad82a60be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc44c7fc70a46bc8603921009a364a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:32Z,use_quota=True,user_id='26af51f3b1e54daebd0b4173e40a4f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599d03d9-83d0-4887-a376-5702e348ca28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599d03d9-83d0-4887-a376-5702e348ca28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ab3122-0e65-40f7-af13-3d19811e87e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ab3122-0e65-40f7-af13-3d19811e87e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff39ac7f-2601-42db-a595-d8fad82a60be', 'volume_name': 'volume-ff39ac7f-2601-42db-a595-d8fad82a60be', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b55cee2-f622-4215-a49e-60699c44b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b55cee2-f622-4215-a49e-60699c44b54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa74123d-9e80-4009-80fc-260b9b17e8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:32 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Volume ff39ac7f-2601-42db-a595-d8fad82a60be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff39ac7f-2601-42db-a595-d8fad82a60be', 'volume_size': 1} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1257033813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff39ac7f-2601-42db-a595-d8fad82a60be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc44c7fc70a46bc8603921009a364a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:32Z,use_quota=True,user_id='26af51f3b1e54daebd0b4173e40a4f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Creating volume ff39ac7f-2601-42db-a595-d8fad82a60be {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:32 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:32 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be 1073741824 Jul 15 18:37:32 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:33 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be 1073741824" returned: 0 in 0.625s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:33 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be Jul 15 18:37:33 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-505ef219-78dd-4022-81ea-6e6dd4623482 req-eb367714-df62-4c57-ad9c-6221a718d575 tempest-TestServerVolumeAttachmentScenario-211886262 None] Terminate volume connection completed successfully. Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-505ef219-78dd-4022-81ea-6e6dd4623482 req-eb367714-df62-4c57-ad9c-6221a718d575 tempest-TestServerVolumeAttachmentScenario-211886262 None] Deleting attachment 0fc9e954-9929-4dd7-bf5a-002fa85b1ede. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:37:33 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be" returned: 0 in 0.305s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.855s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa74123d-9e80-4009-80fc-260b9b17e8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff39ac7f-2601-42db-a595-d8fad82a60be', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15fd126-df9e-44da-9634-799cef669aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Creating offline snapshot 5fdd9bce-5af7-42d8-8e5f-b83828f646fc of volume 223267fd-0bd8-475c-8507-a6591e7ae1e8 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:37:33 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Volume volume-ff39ac7f-2601-42db-a595-d8fad82a60be (ff39ac7f-2601-42db-a595-d8fad82a60be): created successfully Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15fd126-df9e-44da-9634-799cef669aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Flow 'volume_create_manager' (3e6db0b5-2305-436f-8ece-b5af08e4690d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e1976-c43a-4690-85f0-3ef1b84591cf]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-89f0707e-b1e8-42a3-b6e4-a2e8c24a0c1b tempest-AttachVolumeNegativeTest-946525463 None] Created volume successfully. Jul 15 18:37:33 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 Jul 15 18:37:33 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:34 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8" returned: 0 in 0.503s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:34 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc 1G Jul 15 18:37:34 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:34 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc 1G" returned: 0 in 0.549s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:34 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc Jul 15 18:37:34 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:35 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:37:35 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:35 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc" returned: 0 in 0.686s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:35 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc is being set with open permissions: ugo+rw Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:35 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc Jul 15 18:37:35 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:35 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.529s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-73f5c752-eb30-45f2-a057-a3b6b1d7a48d req-1e5e90e0-5320-4654-8438-f0ee7b5259ac tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:35 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc" returned: 0 in 0.516s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:36 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.info Jul 15 18:37:36 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:36 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.info" returned: 0 in 0.342s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:36 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.info is being set with open permissions: ugo+rw Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:36 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.info Jul 15 18:37:36 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Flow 'volume_create_manager' (c7102cdc-1658-4ef4-aafd-1bcb5c9945c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bc0758-f577-47e2-b9dd-690ebf579770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bc0758-f577-47e2-b9dd-690ebf579770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1249743537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f181fc641f4680b0aacfcdb20faae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:36Z,use_quota=True,user_id='7806163100dc4e36b8ced197853d1634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de3c3d6-86fd-4766-9c7a-02b4d41429f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de3c3d6-86fd-4766-9c7a-02b4d41429f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d734c3c-e249-43da-9ecb-f545a2e870fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d734c3c-e249-43da-9ecb-f545a2e870fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b', 'volume_name': 'volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359d15cf-3297-4165-b3a6-42b482015298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359d15cf-3297-4165-b3a6-42b482015298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b900ad87-3caf-48b6-889b-f3852e5d9adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:36 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Volume b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b', 'volume_size': 1} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:36 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.info" returned: 0 in 0.308s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.071s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-73f5c752-eb30-45f2-a057-a3b6b1d7a48d req-1e5e90e0-5320-4654-8438-f0ee7b5259ac tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.848s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940524b-d54d-46b2-a1c1-a8c95b476ebc]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-73f5c752-eb30-45f2-a057-a3b6b1d7a48d req-1e5e90e0-5320-4654-8438-f0ee7b5259ac tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:36 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e9a06fb1-9652-4b69-9fd0-cc6794fa6194 tempest-SnapshotMetadataTestJSON-1437214964 None] Create snapshot completed successfully Jul 15 18:37:36 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be Jul 15 18:37:36 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:37 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-73f5c752-eb30-45f2-a057-a3b6b1d7a48d req-1e5e90e0-5320-4654-8438-f0ee7b5259ac tempest-AttachVolumeNegativeTest-946525463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be" returned: 0 in 0.424s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-73f5c752-eb30-45f2-a057-a3b6b1d7a48d req-1e5e90e0-5320-4654-8438-f0ee7b5259ac tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.450s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1249743537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f181fc641f4680b0aacfcdb20faae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:36Z,use_quota=True,user_id='7806163100dc4e36b8ced197853d1634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Creating volume b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:37 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:37 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b 1073741824 Jul 15 18:37:37 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-73f5c752-eb30-45f2-a057-a3b6b1d7a48d req-1e5e90e0-5320-4654-8438-f0ee7b5259ac tempest-AttachVolumeNegativeTest-946525463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-ff39ac7f-2601-42db-a595-d8fad82a60be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '240ea2e9-1884-4738-8bd7-63d3698d51b9', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:37:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-73f5c752-eb30-45f2-a057-a3b6b1d7a48d req-1e5e90e0-5320-4654-8438-f0ee7b5259ac tempest-AttachVolumeNegativeTest-946525463 None] attachment_update completed successfully. Jul 15 18:37:37 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b 1073741824" returned: 0 in 0.674s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:37 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b Jul 15 18:37:37 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:38 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b" returned: 0 in 0.359s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b900ad87-3caf-48b6-889b-f3852e5d9adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93864d0-6b92-4a3b-a335-20bbe1a13c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:38 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Volume volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b (b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b): created successfully Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93864d0-6b92-4a3b-a335-20bbe1a13c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Flow 'volume_create_manager' (c7102cdc-1658-4ef4-aafd-1bcb5c9945c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ffa0572c-1238-4105-abc0-b3db7d889f9d tempest-AttachVolumeTestJSON-1801034467 None] Created volume successfully. Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Acquiring lock "cinder-5fdd9bce-5af7-42d8-8e5f-b83828f646fc-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "cinder-5fdd9bce-5af7-42d8-8e5f-b83828f646fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Acquiring lock "cinder-quobyte-223267fd-0bd8-475c-8507-a6591e7ae1e8" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "cinder-quobyte-223267fd-0bd8-475c-8507-a6591e7ae1e8" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Acquiring lock "cinder-quobyte-5fdd9bce-5af7-42d8-8e5f-b83828f646fc" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "cinder-quobyte-5fdd9bce-5af7-42d8-8e5f-b83828f646fc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Deleting offline snapshot 5fdd9bce-5af7-42d8-8e5f-b83828f646fc of volume 223267fd-0bd8-475c-8507-a6591e7ae1e8 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] snapshot_file for this snap is: volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c487a2c4-d0bd-4d46-9c8b-5f6b267b591d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:38 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc Jul 15 18:37:38 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "cinder-572c8a75-7769-4f90-bf6e-5310649eecfb-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "cinder-572c8a75-7769-4f90-bf6e-5310649eecfb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "cinder-quobyte-572c8a75-7769-4f90-bf6e-5310649eecfb" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "cinder-quobyte-572c8a75-7769-4f90-bf6e-5310649eecfb" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:39 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc" returned: 0 in 0.518s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-223267fd-0bd8-475c-8507-a6591e7ae1e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a8334e-4a75-4063-b24e-18b7ef09ae7b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5295f92-a3a3-4b73-970a-437bdbd4828a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:39 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb Jul 15 18:37:39 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:39 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 Jul 15 18:37:39 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-9aadab2e-ce07-4786-90a9-83fc4f2ca14b req-3125df5a-8119-4e84-bbcf-07cf118ecc41 tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-9aadab2e-ce07-4786-90a9-83fc4f2ca14b req-3125df5a-8119-4e84-bbcf-07cf118ecc41 tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a25249a-c268-46a1-bf2e-a0643271f5f3]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-9aadab2e-ce07-4786-90a9-83fc4f2ca14b req-3125df5a-8119-4e84-bbcf-07cf118ecc41 tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:39 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb" returned: 0 in 0.603s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:39 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8" returned: 0 in 0.608s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:39 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb Jul 15 18:37:39 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:39 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc Jul 15 18:37:39 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:39 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b Jul 15 18:37:39 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:39 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-8c832ef9-cf97-419c-a889-c06e0c1610e0 req-299d5fad-68cb-4f40-bcbd-3d50137b8383 tempest-AttachVolumeNegativeTest-946525463 None] Terminate volume connection completed successfully. Jul 15 18:37:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-8c832ef9-cf97-419c-a889-c06e0c1610e0 req-299d5fad-68cb-4f40-bcbd-3d50137b8383 tempest-AttachVolumeNegativeTest-946525463 None] Deleting attachment 240ea2e9-1884-4738-8bd7-63d3698d51b9. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:37:40 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-572c8a75-7769-4f90-bf6e-5310649eecfb" returned: 0 in 0.368s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "cinder-quobyte-572c8a75-7769-4f90-bf6e-5310649eecfb" released by "delete_volume" :: held 1.042s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Created reservations ['d41543b2-147e-4c62-ad14-bbebe0ba18c3', 'b70c2a7f-b87d-4182-ab32-2841d4a16877', '3ddb3832-0fcd-405b-aa76-e8cfbe9b9624', '4bb59502-96db-4eaf-b230-f7e709a495ef'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:40 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-9aadab2e-ce07-4786-90a9-83fc4f2ca14b req-3125df5a-8119-4e84-bbcf-07cf118ecc41 tempest-AttachVolumeTestJSON-1801034467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b" returned: 0 in 0.528s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-9aadab2e-ce07-4786-90a9-83fc4f2ca14b req-3125df5a-8119-4e84-bbcf-07cf118ecc41 tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.549s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:40 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc" returned: 0 in 0.513s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:40 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc Jul 15 18:37:40 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-9aadab2e-ce07-4786-90a9-83fc4f2ca14b req-3125df5a-8119-4e84-bbcf-07cf118ecc41 tempest-AttachVolumeTestJSON-1801034467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0878b162-de0c-4f7c-8b8e-058036471daf', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:40 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:37:40 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:40 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-9aadab2e-ce07-4786-90a9-83fc4f2ca14b req-3125df5a-8119-4e84-bbcf-07cf118ecc41 tempest-AttachVolumeTestJSON-1801034467 None] attachment_update completed successfully. Jul 15 18:37:40 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8.5fdd9bce-5af7-42d8-8e5f-b83828f646fc" returned: 0 in 0.361s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:40 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.322s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "cinder-quobyte-5fdd9bce-5af7-42d8-8e5f-b83828f646fc" released by "_delete_snapshot" :: held 2.172s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:40 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Deleted volume successfully. Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "cinder-quobyte-223267fd-0bd8-475c-8507-a6591e7ae1e8" released by "delete_snapshot" :: held 2.215s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5510a164-d556-4cdd-a39e-9308e503f7a3 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "cinder-572c8a75-7769-4f90-bf6e-5310649eecfb-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Created reservations ['b639370a-5bb8-4353-ac61-9f36d2e3e034', '19076b3a-4a37-46fa-b3a7-ba096c46347b', '963b76dd-d2cf-4ce7-bcd6-ea5be3f07049', '9f910dff-6815-4ef6-9085-acc7767bdcc3'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:40 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Delete snapshot completed successfully. Jul 15 18:37:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c061785b-b571-4154-9c6d-65c1ee6f1778 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "cinder-5fdd9bce-5af7-42d8-8e5f-b83828f646fc-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "cinder-e356fb58-7126-4473-a0a5-6096fc5cb5bb-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "cinder-e356fb58-7126-4473-a0a5-6096fc5cb5bb-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "cinder-quobyte-e356fb58-7126-4473-a0a5-6096fc5cb5bb" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "cinder-quobyte-e356fb58-7126-4473-a0a5-6096fc5cb5bb" acquired by "delete_volume" :: waited 0.057s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:41 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743f34b-3745-4364-91c9-c63de8d5c3cc]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:41 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb Jul 15 18:37:41 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Acquiring lock "cinder-223267fd-0bd8-475c-8507-a6591e7ae1e8-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "cinder-223267fd-0bd8-475c-8507-a6591e7ae1e8-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Acquiring lock "cinder-quobyte-223267fd-0bd8-475c-8507-a6591e7ae1e8" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "cinder-quobyte-223267fd-0bd8-475c-8507-a6591e7ae1e8" acquired by "delete_volume" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9fa16e-cc63-44f4-93f9-438c65e03f8c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:42 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb" returned: 0 in 0.668s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:42 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 Jul 15 18:37:42 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:42 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb Jul 15 18:37:42 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:42 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8" returned: 0 in 0.508s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:42 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8 Jul 15 18:37:42 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:42 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e356fb58-7126-4473-a0a5-6096fc5cb5bb" returned: 0 in 0.435s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "cinder-quobyte-e356fb58-7126-4473-a0a5-6096fc5cb5bb" released by "delete_volume" :: held 1.212s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Created reservations ['ffc5b247-4c58-4ab2-b899-c99e1f7914da', 'ce6382dd-4f67-4736-bf35-96820982340c', 'c4fddfe6-b340-490a-b4c8-46937603d7b8', 'add59c6b-3ce1-4701-9439-06ef1d08bafa'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:43 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:37:43 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:43 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-223267fd-0bd8-475c-8507-a6591e7ae1e8" returned: 0 in 0.343s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "cinder-quobyte-223267fd-0bd8-475c-8507-a6591e7ae1e8" released by "delete_volume" :: held 0.947s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Created reservations ['d3d0f13e-84b4-4cf4-bc3c-6c0758d6879e', '57b344fa-f256-408c-966c-ddaa366582f6', '6a98f732-474d-4b47-84df-f4a1a0e36d02', '6ebede00-b487-4e0c-a553-c333d1847c3c'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:43 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:37:43 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:43 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.422s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:43 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Deleted volume successfully. Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-381faffe-9e61-4853-a385-71159ae43bd2 tempest-TestServerVolumeAttachmentScenario-211886262 None] Lock "cinder-e356fb58-7126-4473-a0a5-6096fc5cb5bb-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:43 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.316s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:43 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Deleted volume successfully. Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-346d4b98-1f1e-4fd3-9f30-8668c3de01e7 tempest-SnapshotMetadataTestJSON-1437214964 None] Lock "cinder-223267fd-0bd8-475c-8507-a6591e7ae1e8-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Flow 'volume_create_manager' (291c4326-e58b-4d49-bc95-5d310ac6e63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebd5df1-6835-422b-a8be-5555c4002b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebd5df1-6835-422b-a8be-5555c4002b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1197704084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93083a6c-1835-4af2-9cc4-f6291b147aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f181fc641f4680b0aacfcdb20faae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:44Z,use_quota=True,user_id='7806163100dc4e36b8ced197853d1634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f417fb27-eec4-4b50-a1f7-e677ece204ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f417fb27-eec4-4b50-a1f7-e677ece204ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19246a06-62c5-4360-a6ae-f602920d9a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19246a06-62c5-4360-a6ae-f602920d9a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93083a6c-1835-4af2-9cc4-f6291b147aa5', 'volume_name': 'volume-93083a6c-1835-4af2-9cc4-f6291b147aa5', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45db693-3e61-40c2-901e-9509c12fcc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45db693-3e61-40c2-901e-9509c12fcc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68d9da8-94e0-40a6-9e90-79e2039e08f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:43 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Volume 93083a6c-1835-4af2-9cc4-f6291b147aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93083a6c-1835-4af2-9cc4-f6291b147aa5', 'volume_size': 1} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1197704084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93083a6c-1835-4af2-9cc4-f6291b147aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f181fc641f4680b0aacfcdb20faae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:44Z,use_quota=True,user_id='7806163100dc4e36b8ced197853d1634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Creating volume 93083a6c-1835-4af2-9cc4-f6291b147aa5 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:43 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:37:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:43 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 1073741824 Jul 15 18:37:43 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:44 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 1073741824" returned: 0 in 0.625s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:44 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 Jul 15 18:37:44 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:44 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5" returned: 0 in 0.319s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68d9da8-94e0-40a6-9e90-79e2039e08f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93083a6c-1835-4af2-9cc4-f6291b147aa5', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (625426c8-4f5f-467b-845f-9d1e94cf502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Volume volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 (93083a6c-1835-4af2-9cc4-f6291b147aa5): created successfully Jul 15 18:37:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (625426c8-4f5f-467b-845f-9d1e94cf502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Flow 'volume_create_manager' (291c4326-e58b-4d49-bc95-5d310ac6e63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6ff6141e-fedc-4259-b841-7325ac35746a tempest-AttachVolumeTestJSON-1801034467 None] Created volume successfully. Jul 15 18:37:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-cd51f774-52ed-47c4-9c5e-8a5893e555d1 req-6abf8313-f165-400a-8b73-5e820a250a34 tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-cd51f774-52ed-47c4-9c5e-8a5893e555d1 req-6abf8313-f165-400a-8b73-5e820a250a34 tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:46 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd19765-f7fc-4dd6-ad42-d4ef5abeeeb0]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-cd51f774-52ed-47c4-9c5e-8a5893e555d1 req-6abf8313-f165-400a-8b73-5e820a250a34 tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:47 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 Jul 15 18:37:47 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:47 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-cd51f774-52ed-47c4-9c5e-8a5893e555d1 req-6abf8313-f165-400a-8b73-5e820a250a34 tempest-AttachVolumeTestJSON-1801034467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5" returned: 0 in 0.545s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-cd51f774-52ed-47c4-9c5e-8a5893e555d1 req-6abf8313-f165-400a-8b73-5e820a250a34 tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.577s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-cd51f774-52ed-47c4-9c5e-8a5893e555d1 req-6abf8313-f165-400a-8b73-5e820a250a34 tempest-AttachVolumeTestJSON-1801034467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-93083a6c-1835-4af2-9cc4-f6291b147aa5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a13d1b0-b69c-424a-b8fe-b2a0cf9dcb8c', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:37:47 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-cd51f774-52ed-47c4-9c5e-8a5893e555d1 req-6abf8313-f165-400a-8b73-5e820a250a34 tempest-AttachVolumeTestJSON-1801034467 None] attachment_update completed successfully. Jul 15 18:37:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-09028f7b-6b5b-47dc-a4f5-39380671f1ee req-34ad7a36-9aec-46ea-9142-1712a43a9e82 tempest-AttachVolumeTestJSON-1801034467 None] Terminate volume connection completed successfully. Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-09028f7b-6b5b-47dc-a4f5-39380671f1ee req-34ad7a36-9aec-46ea-9142-1712a43a9e82 tempest-AttachVolumeTestJSON-1801034467 None] Deleting attachment 0878b162-de0c-4f7c-8b8e-058036471daf. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Flow 'volume_create_manager' (c9aaaf84-c5f0-45b7-88d7-cb7736d73165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9239eb-8a79-4093-84cc-057490eb4f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9239eb-8a79-4093-84cc-057490eb4f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1643084248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a96f80-5143-443c-95f5-309dbabaf5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4e8a4c08b74cd9a0649da7cfb892a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:50Z,use_quota=True,user_id='92e9a44c728d4fcab64bf3f121b324a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8169035-290f-48cd-8fcb-e4b51cd08ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8169035-290f-48cd-8fcb-e4b51cd08ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a89aac0-bcbd-412d-9e96-1c19b10e87c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a89aac0-bcbd-412d-9e96-1c19b10e87c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a96f80-5143-443c-95f5-309dbabaf5e1', 'volume_name': 'volume-92a96f80-5143-443c-95f5-309dbabaf5e1', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af19a252-9d3f-45cf-b927-5f94fffab45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af19a252-9d3f-45cf-b927-5f94fffab45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04bbf1c1-7451-4dab-926d-da4a63a10149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:50 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Volume 92a96f80-5143-443c-95f5-309dbabaf5e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a96f80-5143-443c-95f5-309dbabaf5e1', 'volume_size': 1} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1643084248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a96f80-5143-443c-95f5-309dbabaf5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4e8a4c08b74cd9a0649da7cfb892a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:50Z,use_quota=True,user_id='92e9a44c728d4fcab64bf3f121b324a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Creating volume 92a96f80-5143-443c-95f5-309dbabaf5e1 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:50 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:37:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:50 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1 1073741824 Jul 15 18:37:50 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:51 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1 1073741824" returned: 0 in 0.656s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:51 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1 Jul 15 18:37:51 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:51 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1" returned: 0 in 0.377s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04bbf1c1-7451-4dab-926d-da4a63a10149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a96f80-5143-443c-95f5-309dbabaf5e1', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13dde5b2-e4be-4b5f-be69-7dd2b35d1249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:51 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Volume volume-92a96f80-5143-443c-95f5-309dbabaf5e1 (92a96f80-5143-443c-95f5-309dbabaf5e1): created successfully Jul 15 18:37:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13dde5b2-e4be-4b5f-be69-7dd2b35d1249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Flow 'volume_create_manager' (c9aaaf84-c5f0-45b7-88d7-cb7736d73165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:51 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a6162063-9d62-4ac3-b2eb-3921f3a6e068 tempest-AbsoluteLimitsTests-1823050989 None] Created volume successfully. Jul 15 18:37:51 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-73c470b1-74d9-4891-9bd1-200c138944c1 req-e039e63b-5148-4564-8805-9ded5c1550d0 tempest-AttachVolumeTestJSON-1801034467 None] Terminate volume connection completed successfully. Jul 15 18:37:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-73c470b1-74d9-4891-9bd1-200c138944c1 req-e039e63b-5148-4564-8805-9ded5c1550d0 tempest-AttachVolumeTestJSON-1801034467 None] Deleting attachment 3a13d1b0-b69c-424a-b8fe-b2a0cf9dcb8c. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:37:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Acquiring lock "cinder-92a96f80-5143-443c-95f5-309dbabaf5e1-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Lock "cinder-92a96f80-5143-443c-95f5-309dbabaf5e1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Acquiring lock "cinder-quobyte-92a96f80-5143-443c-95f5-309dbabaf5e1" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Lock "cinder-quobyte-92a96f80-5143-443c-95f5-309dbabaf5e1" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:52 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c79b912-d697-4853-8893-749a450494a9]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:53 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1 Jul 15 18:37:53 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:53 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1" returned: 0 in 0.608s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:53 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1 Jul 15 18:37:53 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:54 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-92a96f80-5143-443c-95f5-309dbabaf5e1" returned: 0 in 0.520s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Lock "cinder-quobyte-92a96f80-5143-443c-95f5-309dbabaf5e1" released by "delete_volume" :: held 1.198s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Created reservations ['2451b452-db43-41c1-8cf2-e46f5c3e0726', '5dea5c43-8b0c-4f23-a25c-e989f79c9f6b', 'a44b84e6-3ecb-42ac-8cfa-2e7cfa72396c', 'c1c4b0bf-ddc8-44b1-a3d4-08f878577fa3'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:54 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:37:54 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:54 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.332s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Deleted volume successfully. Jul 15 18:37:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63d42156-71fb-4b8e-996d-3cf9e166c2f8 tempest-AbsoluteLimitsTests-1823050989 None] Lock "cinder-92a96f80-5143-443c-95f5-309dbabaf5e1-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "cinder-93083a6c-1835-4af2-9cc4-f6291b147aa5-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-93083a6c-1835-4af2-9cc4-f6291b147aa5-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "cinder-quobyte-93083a6c-1835-4af2-9cc4-f6291b147aa5" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-quobyte-93083a6c-1835-4af2-9cc4-f6291b147aa5" acquired by "delete_volume" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:01 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf44e78-6797-4951-b8de-4a3380cddbaf]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:01 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 Jul 15 18:38:01 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:02 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5" returned: 0 in 0.701s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:02 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5 Jul 15 18:38:02 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:02 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93083a6c-1835-4af2-9cc4-f6291b147aa5" returned: 0 in 0.494s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-quobyte-93083a6c-1835-4af2-9cc4-f6291b147aa5" released by "delete_volume" :: held 1.310s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Created reservations ['4a2b5edb-8c6a-45ee-85a3-6b26808648b5', '0812ead7-9be7-4f5a-baf1-d0a7f68f00b4', '61b86239-929e-4446-809d-ab0a01f7e842', '5537e6e5-e449-40c3-a3ef-4223b473ebf0'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:03 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:03 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:03 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.363s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:03 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Deleted volume successfully. Jul 15 18:38:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-870bbff5-b144-48e6-a763-75113dd34571 tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-93083a6c-1835-4af2-9cc4-f6291b147aa5-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "cinder-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "cinder-quobyte-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-quobyte-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b" acquired by "delete_volume" :: waited 0.040s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a30f01-17bf-4bd4-845d-c906caafb1ce]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Flow 'volume_create_manager' (5b069e1d-b08f-49f2-a1f0-6a1badcd8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941fdd40-beda-4f53-a621-c6b2b87020b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941fdd40-beda-4f53-a621-c6b2b87020b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-333175809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853cddb3-9ece-4558-a640-c4b0a7b1bbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206e133b211846bb9066bb64312b16e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:04Z,use_quota=True,user_id='411c46f7392a426787db985280c02048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a679480-7dc3-4338-83e3-7657ef091120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:04 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a679480-7dc3-4338-83e3-7657ef091120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:04 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d56d283-d68e-4ff0-8d32-549f8c6200ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG cinder.image.glance [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Creating Keystone auth plugin from conf {{(pid=87863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:38:04 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b" returned: 0 in 0.658s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:04 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b Jul 15 18:38:04 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d56d283-d68e-4ff0-8d32-549f8c6200ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '853cddb3-9ece-4558-a640-c4b0a7b1bbfc', 'volume_name': 'volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904abe2a-3392-4d31-94b5-d6f83058ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904abe2a-3392-4d31-94b5-d6f83058ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9882c441-c43e-44a1-ada1-e8b5a1482b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:05 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Volume 853cddb3-9ece-4558-a640-c4b0a7b1bbfc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Trying to clone 853cddb3-9ece-4558-a640-c4b0a7b1bbfc from image 26627af3-14a2-4924-a235-ca96adb6f0af at location (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]). {{(pid=87863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:38:05 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b" returned: 0 in 0.414s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-quobyte-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b" released by "delete_volume" :: held 1.159s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Created reservations ['b777b8e0-4969-42ef-a535-df8de7181507', 'efa39cce-b327-41f8-bd1a-04948be44c12', 'f9c7de00-6d78-46df-95e7-7fb30ff26164', 'ed63f2a7-16f1-4f11-9f85-7226efe79e0f'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:38:05 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Image download 20.69 MB at 20.69 MB/s Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec44862f-2ed8-4a1b-b8bb-770d23c92259]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:05 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:05 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:06 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD Jul 15 18:38:06 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:06 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.407s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Deleted volume successfully. Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6a5d453a-59f2-4d7f-be9e-166ac782eadf tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-b00c40ac-85a8-4473-b0b9-cae8e8a0fa7b-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:06 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Temporary image 26627af3-14a2-4924-a235-ca96adb6f0af is fetched for user 411c46f7392a426787db985280c02048. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "cinder-d1e390a6-1c15-4656-a260-16d5aa85ee36-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-d1e390a6-1c15-4656-a260-16d5aa85ee36-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[97adc3df-7ece-409b-bf09-3aec34caad02]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "cinder-quobyte-d1e390a6-1c15-4656-a260-16d5aa85ee36" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-quobyte-d1e390a6-1c15-4656-a260-16d5aa85ee36" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdbd382-2dab-440b-b538-db60f11da098]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:06 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD Jul 15 18:38:06 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:07 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 Jul 15 18:38:07 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:07 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-333175809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853cddb3-9ece-4558-a640-c4b0a7b1bbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206e133b211846bb9066bb64312b16e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:04Z,use_quota=True,user_id='411c46f7392a426787db985280c02048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Creating volume 853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:07 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:07 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc 1073741824 Jul 15 18:38:07 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:07 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36" returned: 0 in 0.524s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:07 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36 Jul 15 18:38:07 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:07 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d1e390a6-1c15-4656-a260-16d5aa85ee36" returned: 0 in 0.430s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-quobyte-d1e390a6-1c15-4656-a260-16d5aa85ee36" released by "delete_volume" :: held 1.035s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:07 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc 1073741824" returned: 0 in 0.605s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Created reservations ['692e8fe5-8f4c-4b6c-8f65-3f75f490f9b1', 'c4106a3d-0c7b-41b2-b5c4-b9b2f4c17c4e', 'a1faf4b7-f771-49b9-be29-68da33133002', '640d48d8-0254-411d-af03-826cf3cd45f7'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:08 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc Jul 15 18:38:08 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:08 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:08 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:08 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" returned: 0 in 0.417s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Attempting download of 26627af3-14a2-4924-a235-ca96adb6f0af ((None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}])) to volume 853cddb3-9ece-4558-a640-c4b0a7b1bbfc. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:38:08 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.421s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[650721ff-ca0f-4c45-a99a-ff3f4ae88f64]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_gpwuxz_t {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:08 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Deleted volume successfully. Jul 15 18:38:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e2f38571-427c-4966-849f-d6c3589ffab4 tempest-AttachVolumeTestJSON-1801034467 None] Lock "cinder-d1e390a6-1c15-4656-a260-16d5aa85ee36-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:08 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_gpwuxz_t Jul 15 18:38:08 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:09 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_gpwuxz_t" returned: 0 in 0.620s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_gpwuxz_t {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:09 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_gpwuxz_t Jul 15 18:38:09 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:09 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_gpwuxz_t" returned: 1 in 0.533s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_gpwuxz_t' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:38:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7859c915-b187-4f93-9062-17de0c19803c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:09 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD Jul 15 18:38:09 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:10 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:10 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] 26627af3-14a2-4924-a235-ca96adb6f0af was qcow2, converting to raw {{(pid=87863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:38:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:10 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc Jul 15 18:38:10 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:12 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" returned: 0 in 2.317s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:12 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_7dgmvwahdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:38:12 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Converted 112.00 MB image at 48.31 MB/s Jul 15 18:38:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:12 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc 1G Jul 15 18:38:12 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:13 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc 1G" returned: 0 in 0.459s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4140a9-5afb-4716-b152-43a8157b372b]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:13 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc Jul 15 18:38:13 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:13 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" returned: 0 in 0.838s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:14 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc Jul 15 18:38:14 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:14 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" returned: 1 in 0.538s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Downloaded image 26627af3-14a2-4924-a235-ca96adb6f0af ((None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}])) to volume 853cddb3-9ece-4558-a640-c4b0a7b1bbfc successfully. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Temporary image 26627af3-14a2-4924-a235-ca96adb6f0af for user 411c46f7392a426787db985280c02048 is deleted. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Marking volume 853cddb3-9ece-4558-a640-c4b0a7b1bbfc as bootable. {{(pid=87863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Copying metadata from image 26627af3-14a2-4924-a235-ca96adb6f0af to 853cddb3-9ece-4558-a640-c4b0a7b1bbfc. {{(pid=87863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Creating volume glance metadata for volume 853cddb3-9ece-4558-a640-c4b0a7b1bbfc backed by image 26627af3-14a2-4924-a235-ca96adb6f0af with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9882c441-c43e-44a1-ada1-e8b5a1482b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e907cd8-daa8-4fab-a41f-06fd9b05cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:14 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Volume volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc (853cddb3-9ece-4558-a640-c4b0a7b1bbfc): created successfully Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e907cd8-daa8-4fab-a41f-06fd9b05cad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Flow 'volume_create_manager' (5b069e1d-b08f-49f2-a1f0-6a1badcd8643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:14 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-27a89ebb-7cda-4787-a526-e8b7a5505a01 tempest-VolumesExtendTest-278830853 None] Created volume successfully. Jul 15 18:38:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:15 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadc3ab1-efcc-40e4-8437-96642b7aec0b]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:15 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc Jul 15 18:38:15 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:16 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" returned: 0 in 0.514s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:16 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc Jul 15 18:38:16 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:16 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" returned: 1 in 0.511s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:38:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc 2G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc 2G" returned: 0 in 0.095s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.206s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:17 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e69b1460-b28d-4cd4-9231-b431658ca2cf tempest-VolumesExtendTest-278830853 None] Extend volume completed successfully. Jul 15 18:38:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Acquiring lock "cinder-853cddb3-9ece-4558-a640-c4b0a7b1bbfc-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Lock "cinder-853cddb3-9ece-4558-a640-c4b0a7b1bbfc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Acquiring lock "cinder-quobyte-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Lock "cinder-quobyte-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" acquired by "delete_volume" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:18 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b4abaf-efc8-47bc-b4e6-0aa0bcf502c8]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:18 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc Jul 15 18:38:18 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:19 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" returned: 0 in 0.453s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:19 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc Jul 15 18:38:19 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:19 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" returned: 1 in 0.447s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:38:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:19 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc Jul 15 18:38:19 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:19 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" returned: 0 in 0.368s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Lock "cinder-quobyte-853cddb3-9ece-4558-a640-c4b0a7b1bbfc" released by "delete_volume" :: held 1.388s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:19 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Created reservations ['398f0a99-aa14-4199-8364-b2938e07ef7d', '86a38ce5-5cba-4e6b-86a1-665ad93f70e2', 'dbf9b01c-efa4-4a6a-b5dc-7eee6821441a', '2ace33a3-a9b4-4569-82df-63a891ff538a'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:20 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:20 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:20 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.335s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:20 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Deleted volume successfully. Jul 15 18:38:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-aa4a7785-d310-4200-988d-7152ba39927b tempest-VolumesExtendTest-278830853 None] Lock "cinder-853cddb3-9ece-4558-a640-c4b0a7b1bbfc-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Flow 'volume_create_manager' (92724a1c-ea5f-4ff7-a568-f54a1ac25dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d74211-9dd8-4d53-861b-8d576567d438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d74211-9dd8-4d53-861b-8d576567d438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1259746501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbe5da4-129e-4c3a-a84d-384d008ba13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206e133b211846bb9066bb64312b16e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:21Z,use_quota=True,user_id='411c46f7392a426787db985280c02048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86d898a-c53d-4229-a0b0-7af6090186e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86d898a-c53d-4229-a0b0-7af6090186e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0528ab3-347f-4bae-a392-4823f44aa91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0528ab3-347f-4bae-a392-4823f44aa91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebbe5da4-129e-4c3a-a84d-384d008ba13c', 'volume_name': 'volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3074269-cf11-477d-be0a-9993ace29b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3074269-cf11-477d-be0a-9993ace29b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92a0660-dafc-4ac0-aade-2d9667bc0a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Volume ebbe5da4-129e-4c3a-a84d-384d008ba13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c', 'volume_size': 1} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1259746501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbe5da4-129e-4c3a-a84d-384d008ba13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206e133b211846bb9066bb64312b16e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:21Z,use_quota=True,user_id='411c46f7392a426787db985280c02048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Creating volume ebbe5da4-129e-4c3a-a84d-384d008ba13c {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:21 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:38:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:21 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c 1073741824 Jul 15 18:38:21 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:22 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c 1073741824" returned: 0 in 0.609s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:22 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c Jul 15 18:38:22 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:22 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c" returned: 0 in 0.402s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92a0660-dafc-4ac0-aade-2d9667bc0a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e60d4d6-902e-44ee-9f44-4f745d8600c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:22 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Volume volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c (ebbe5da4-129e-4c3a-a84d-384d008ba13c): created successfully Jul 15 18:38:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e60d4d6-902e-44ee-9f44-4f745d8600c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Flow 'volume_create_manager' (92724a1c-ea5f-4ff7-a568-f54a1ac25dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:22 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-52ec9c6d-2d77-48a9-99ae-f6582bf3cba7 tempest-VolumesExtendTest-278830853 None] Created volume successfully. Jul 15 18:38:23 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=106,cinder:UPDATE=102,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:38:23 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=102,cinder:UPDATE=106,cinder:DELETE=9,cinder:INSERT=30 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:38:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Creating offline snapshot 9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 of volume ebbe5da4-129e-4c3a-a84d-384d008ba13c {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:38:24 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a25cfd-8b5c-4603-8e7e-e1287dffa921]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:24 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c Jul 15 18:38:24 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:24 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c" returned: 0 in 0.469s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:24 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 1G Jul 15 18:38:24 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:25 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 1G" returned: 0 in 0.579s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:25 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 Jul 15 18:38:25 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:25 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76" returned: 0 in 0.602s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:25 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 is being set with open permissions: ugo+rw Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:25 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 Jul 15 18:38:25 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Flow 'volume_create_manager' (5c30e326-15e2-4004-a8c0-1f1891422ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebaec490-4198-47bb-bb3a-6d3e2f9bb885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebaec490-4198-47bb-bb3a-6d3e2f9bb885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1062409303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc44c7fc70a46bc8603921009a364a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:26Z,use_quota=True,user_id='26af51f3b1e54daebd0b4173e40a4f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d955801-3073-4926-a9e6-16658fca585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d955801-3073-4926-a9e6-16658fca585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e8a097-86ce-4a4c-baff-95b6a510ef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e8a097-86ce-4a4c-baff-95b6a510ef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0', 'volume_name': 'volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb44cb9-dfaf-4392-8c62-a845192dcef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb44cb9-dfaf-4392-8c62-a845192dcef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadfec86-1af3-4223-a22e-f174883f09fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:25 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Volume 7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0', 'volume_size': 1} Jul 15 18:38:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:26 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76" returned: 0 in 0.387s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:26 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.info Jul 15 18:38:26 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:26 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.info" returned: 0 in 0.316s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:26 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.info is being set with open permissions: ugo+rw Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:26 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.info Jul 15 18:38:26 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:26 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.info" returned: 0 in 0.310s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1062409303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc44c7fc70a46bc8603921009a364a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:26Z,use_quota=True,user_id='26af51f3b1e54daebd0b4173e40a4f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Creating volume 7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:26 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:38:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:26 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 1073741824 Jul 15 18:38:26 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:26 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9193a028-5a49-43d6-b946-d7a65653a416 tempest-VolumesExtendTest-278830853 None] Create snapshot completed successfully Jul 15 18:38:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-afdec61a-a7c6-4496-93d0-522a5e574772 tempest-GroupsTest-1148943648 None] Group tempest-Group1-346500135: creating Jul 15 18:38:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-afdec61a-a7c6-4496-93d0-522a5e574772 tempest-GroupsTest-1148943648 None] Group tempest-Group1-346500135: created successfully Jul 15 18:38:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-afdec61a-a7c6-4496-93d0-522a5e574772 tempest-GroupsTest-1148943648 None] Create group completed successfully. Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2665a4eb-0ab5-4b91-b81d-e47927b985be tempest-VolumesExtendTest-278830853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:27 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 1073741824" returned: 0 in 0.710s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:27 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 Jul 15 18:38:27 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:27 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0" returned: 0 in 0.307s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2665a4eb-0ab5-4b91-b81d-e47927b985be tempest-VolumesExtendTest-278830853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.593s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadfec86-1af3-4223-a22e-f174883f09fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53258463-de10-41ef-830b-225636929898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0263543-6fcc-4893-b57a-58c52756cbdd]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2665a4eb-0ab5-4b91-b81d-e47927b985be tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:27 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Volume volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 (7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0): created successfully Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53258463-de10-41ef-830b-225636929898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Flow 'volume_create_manager' (5c30e326-15e2-4004-a8c0-1f1891422ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-201f732f-cc75-4c5c-91b6-7bf2c6d081eb tempest-AttachVolumeNegativeTest-946525463 None] Created volume successfully. Jul 15 18:38:28 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c Jul 15 18:38:28 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:28 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-fd770849-8d1f-43fc-b0bb-1544c2c41667 tempest-GroupsTest-1148943648 None] Group tempest-Group2-1280036576: creating Jul 15 18:38:28 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2665a4eb-0ab5-4b91-b81d-e47927b985be tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c" returned: 0 in 0.529s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2665a4eb-0ab5-4b91-b81d-e47927b985be tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 2G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:28 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-fd770849-8d1f-43fc-b0bb-1544c2c41667 tempest-GroupsTest-1148943648 None] Group tempest-Group2-1280036576: created successfully Jul 15 18:38:28 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-fd770849-8d1f-43fc-b0bb-1544c2c41667 tempest-GroupsTest-1148943648 None] Create group completed successfully. Jul 15 18:38:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2665a4eb-0ab5-4b91-b81d-e47927b985be tempest-VolumesExtendTest-278830853 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 2G" returned: 0 in 0.188s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2665a4eb-0ab5-4b91-b81d-e47927b985be tempest-VolumesExtendTest-278830853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.809s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:28 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2665a4eb-0ab5-4b91-b81d-e47927b985be tempest-VolumesExtendTest-278830853 None] Extend volume completed successfully. Jul 15 18:38:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Acquiring lock "cinder-9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Lock "cinder-9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Acquiring lock "cinder-quobyte-ebbe5da4-129e-4c3a-a84d-384d008ba13c" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Lock "cinder-quobyte-ebbe5da4-129e-4c3a-a84d-384d008ba13c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Acquiring lock "cinder-quobyte-9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Lock "cinder-quobyte-9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Deleting offline snapshot 9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 of volume ebbe5da4-129e-4c3a-a84d-384d008ba13c {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:38:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] snapshot_file for this snap is: volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:38:29 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cecc79-009e-47ef-834e-1a57c6aaf499]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-34979858-bafc-4c93-b076-016da4385adf req-28f7b304-85f3-4d9d-a9b9-b2d56cb435ae tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-34979858-bafc-4c93-b076-016da4385adf req-28f7b304-85f3-4d9d-a9b9-b2d56cb435ae tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8151c2a5-6c5a-4453-9c74-50df87d3b095]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-34979858-bafc-4c93-b076-016da4385adf req-28f7b304-85f3-4d9d-a9b9-b2d56cb435ae tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:30 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 Jul 15 18:38:30 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:30 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 Jul 15 18:38:30 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Flow 'volume_create_manager' (665c8f70-b2a2-4812-8aa6-208ce709edf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00f6770-40b0-4031-b700-6067c96059f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00f6770-40b0-4031-b700-6067c96059f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-257057874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9a69681-6c93-4ecf-9c05-310521e29f4f,host='devstack@QuobyteHD#QuobyteHD',id=fab175d1-5708-4f59-aa28-117a35b41b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ba5e8048d54208b3c3cbf2382bbbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:30Z,use_quota=True,user_id='8e86884fedbd4a3b87622cb12dd6abc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89f2657c-1715-4467-90a4-ea22d290bc09),volume_type_id=89f2657c-1715-4467-90a4-ea22d290bc09)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2471abcd-e2ec-49fd-8c24-54723eb00494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2471abcd-e2ec-49fd-8c24-54723eb00494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a137a8be-b8d8-4678-88e2-915900a8832a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a137a8be-b8d8-4678-88e2-915900a8832a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab175d1-5708-4f59-aa28-117a35b41b88', 'volume_name': 'volume-fab175d1-5708-4f59-aa28-117a35b41b88', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda1b758-fc4f-427b-b764-af6bda13a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda1b758-fc4f-427b-b764-af6bda13a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788b146b-5edd-4f78-993a-d32b7ee662a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:30 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Volume fab175d1-5708-4f59-aa28-117a35b41b88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab175d1-5708-4f59-aa28-117a35b41b88', 'volume_size': 1} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:30 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76" returned: 0 in 0.566s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:38:30 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-34979858-bafc-4c93-b076-016da4385adf req-28f7b304-85f3-4d9d-a9b9-b2d56cb435ae tempest-AttachVolumeNegativeTest-946525463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0" returned: 0 in 0.520s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-34979858-bafc-4c93-b076-016da4385adf req-28f7b304-85f3-4d9d-a9b9-b2d56cb435ae tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.551s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.195s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9a69681-6c93-4ecf-9c05-310521e29f4f,created_at=2026-07-15T16:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-257057874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9a69681-6c93-4ecf-9c05-310521e29f4f,host='devstack@QuobyteHD#QuobyteHD',id=fab175d1-5708-4f59-aa28-117a35b41b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ba5e8048d54208b3c3cbf2382bbbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:30Z,use_quota=True,user_id='8e86884fedbd4a3b87622cb12dd6abc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89f2657c-1715-4467-90a4-ea22d290bc09),volume_type_id=89f2657c-1715-4467-90a4-ea22d290bc09)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Creating volume fab175d1-5708-4f59-aa28-117a35b41b88 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:30 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af10be6-27ad-4c56-85f2-377d1caf2e5e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:30 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88 1073741824 Jul 15 18:38:30 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-34979858-bafc-4c93-b076-016da4385adf req-28f7b304-85f3-4d9d-a9b9-b2d56cb435ae tempest-AttachVolumeNegativeTest-946525463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '768b75f9-4e7d-4e55-8c21-3b5e15bfa757', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:38:30 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c Jul 15 18:38:30 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:30 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-34979858-bafc-4c93-b076-016da4385adf req-28f7b304-85f3-4d9d-a9b9-b2d56cb435ae tempest-AttachVolumeNegativeTest-946525463 None] attachment_update completed successfully. Jul 15 18:38:31 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c" returned: 0 in 0.622s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:31 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 Jul 15 18:38:31 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:31 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88 1073741824" returned: 0 in 0.882s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:31 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88 Jul 15 18:38:31 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:31 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76" returned: 0 in 0.698s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:31 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76 Jul 15 18:38:31 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:32 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88" returned: 0 in 0.429s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788b146b-5edd-4f78-993a-d32b7ee662a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab175d1-5708-4f59-aa28-117a35b41b88', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef51b6f-6ee7-46f9-b88e-0fa1ab1de63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:32 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Volume volume-fab175d1-5708-4f59-aa28-117a35b41b88 (fab175d1-5708-4f59-aa28-117a35b41b88): created successfully Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef51b6f-6ee7-46f9-b88e-0fa1ab1de63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Flow 'volume_create_manager' (665c8f70-b2a2-4812-8aa6-208ce709edf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:32 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-04e4c63b-f498-4043-8a1f-f51b6f64c291 tempest-GroupsTest-1148943648 None] Created volume successfully. Jul 15 18:38:32 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c.9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76" returned: 0 in 0.305s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Lock "cinder-quobyte-9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76" released by "_delete_snapshot" :: held 2.383s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Lock "cinder-quobyte-ebbe5da4-129e-4c3a-a84d-384d008ba13c" released by "delete_snapshot" :: held 2.420s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Created reservations ['7dcef6ee-b480-4038-a03f-9af24812c4ab', 'f7d79505-5769-42ae-beef-504290790375', 'b432f29b-b832-4ee0-a7f8-bede45f064cb', '147eaedb-060a-47cf-81e4-8e06b4fb2544'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:32 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Delete snapshot completed successfully. Jul 15 18:38:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3128a498-80d7-46c9-8e2b-5ca624785e91 tempest-VolumesExtendTest-278830853 None] Lock "cinder-9ecb2302-fbdf-4a9f-8cb0-77c3f68eea76-delete_snapshot" released by "delete_snapshot" :: held 2.591s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Acquiring lock "cinder-ebbe5da4-129e-4c3a-a84d-384d008ba13c-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Lock "cinder-ebbe5da4-129e-4c3a-a84d-384d008ba13c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Acquiring lock "cinder-quobyte-ebbe5da4-129e-4c3a-a84d-384d008ba13c" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Lock "cinder-quobyte-ebbe5da4-129e-4c3a-a84d-384d008ba13c" acquired by "delete_volume" :: waited 0.039s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:33 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f34393-cdd9-4f95-ad59-503be0d3ec6a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Acquiring lock "cinder-quobyte-fab175d1-5708-4f59-aa28-117a35b41b88" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:33 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c Jul 15 18:38:33 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Lock "cinder-quobyte-fab175d1-5708-4f59-aa28-117a35b41b88" acquired by "delete_volume" :: waited 0.044s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:33 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a775d2c-d773-43a0-b5f8-53ca195fd880]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:33 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88 Jul 15 18:38:33 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:34 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:34 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-c100fa7f-cd54-4b84-b111-2352b1f90840 req-7999265d-dca0-4a40-bf02-310d4e6640e5 tempest-AttachVolumeNegativeTest-946525463 None] Terminate volume connection completed successfully. Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-c100fa7f-cd54-4b84-b111-2352b1f90840 req-7999265d-dca0-4a40-bf02-310d4e6640e5 tempest-AttachVolumeNegativeTest-946525463 None] Deleting attachment 768b75f9-4e7d-4e55-8c21-3b5e15bfa757. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c" returned: 0 in 0.684s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:34 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c Jul 15 18:38:34 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:34 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88" returned: 0 in 0.541s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:34 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88 Jul 15 18:38:34 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:34 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ebbe5da4-129e-4c3a-a84d-384d008ba13c" returned: 0 in 0.390s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Lock "cinder-quobyte-ebbe5da4-129e-4c3a-a84d-384d008ba13c" released by "delete_volume" :: held 1.189s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Created reservations ['5b8d96e7-a542-48d7-9a28-a5224a018e4b', '511e89d0-ed7b-4cdc-94de-147263c94b9a', '0ce89b77-a386-4a43-a087-1f1698d31570', '99db28bf-9d7f-4b4c-9627-ca8b31afa231'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:34 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:34 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:34 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fab175d1-5708-4f59-aa28-117a35b41b88" returned: 0 in 0.485s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Lock "cinder-quobyte-fab175d1-5708-4f59-aa28-117a35b41b88" released by "delete_volume" :: held 1.101s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:34 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Created reservations ['da0990dc-1a77-475b-9480-1b90d829aea0'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:35 devstack cinder-volume[87863]: WARNING cinder.quota [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1700635589 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1700635589, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:38:35 devstack cinder-volume[87863]: WARNING cinder.quota [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1700635589 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1700635589, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Created reservations ['79667a97-1333-410b-b33a-c0a7207d9adc', 'cf418170-fb0e-49a1-a7dd-95d639d0746b', '2584ddfd-2a35-4cea-9291-a574fb31ef98', '5f6b0f79-18fc-46ee-a616-3ff02c17becb'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:35 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:35 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:35 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.526s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:35 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Deleted volume successfully. Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-40280f18-414c-4b6e-b79d-bee5fa913235 tempest-VolumesExtendTest-278830853 None] Lock "cinder-ebbe5da4-129e-4c3a-a84d-384d008ba13c-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:35 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:35 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:35 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.396s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:38:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:38:36 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.591s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:36 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c2c0a41e-8173-4205-ba5e-fb9a2d07f7a5 tempest-GroupsTest-1148943648 None] Delete group completed successfully. Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Flow 'volume_create_manager' (a6a614d9-5e0f-47d4-b1be-33e2184f85f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ab899e-06ec-48bf-ba18-793486c92b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ab899e-06ec-48bf-ba18-793486c92b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-638544349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc7b30a-c746-40de-92cf-f0508037edc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598e16f4e73240efbba84c525a8b437e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:36Z,use_quota=True,user_id='82f0be5d0b5d48fa9d8f85fd3c411fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165a872a-2a0a-4da8-9ed0-a33224a2d664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165a872a-2a0a-4da8-9ed0-a33224a2d664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c214851a-b246-425d-912d-107265865757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c214851a-b246-425d-912d-107265865757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc7b30a-c746-40de-92cf-f0508037edc4', 'volume_name': 'volume-fbc7b30a-c746-40de-92cf-f0508037edc4', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c760fd-a9ad-4ecd-883f-8b17ed1d12bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c760fd-a9ad-4ecd-883f-8b17ed1d12bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb99f394-dbbf-4ff9-84ed-0ec7f14a715a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:36 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Volume fbc7b30a-c746-40de-92cf-f0508037edc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc7b30a-c746-40de-92cf-f0508037edc4', 'volume_size': 1} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-638544349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc7b30a-c746-40de-92cf-f0508037edc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598e16f4e73240efbba84c525a8b437e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:36Z,use_quota=True,user_id='82f0be5d0b5d48fa9d8f85fd3c411fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Creating volume fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:36 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:36 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 1073741824 Jul 15 18:38:36 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-71dcbc74-5617-4fb9-a18b-23d597d8d47d tempest-GroupsTest-1148943648 None] Created reservations ['729d6fa7-3470-4550-bb51-9f0ccb49aed0'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71dcbc74-5617-4fb9-a18b-23d597d8d47d tempest-GroupsTest-1148943648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71dcbc74-5617-4fb9-a18b-23d597d8d47d tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-71dcbc74-5617-4fb9-a18b-23d597d8d47d tempest-GroupsTest-1148943648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-71dcbc74-5617-4fb9-a18b-23d597d8d47d tempest-GroupsTest-1148943648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71dcbc74-5617-4fb9-a18b-23d597d8d47d tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71dcbc74-5617-4fb9-a18b-23d597d8d47d tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:36 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:36 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:36 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71dcbc74-5617-4fb9-a18b-23d597d8d47d tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.336s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:36 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-71dcbc74-5617-4fb9-a18b-23d597d8d47d tempest-GroupsTest-1148943648 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:36 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-71dcbc74-5617-4fb9-a18b-23d597d8d47d tempest-GroupsTest-1148943648 None] Delete group completed successfully. Jul 15 18:38:37 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 1073741824" returned: 0 in 0.737s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:37 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 Jul 15 18:38:37 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:37 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4" returned: 0 in 0.340s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb99f394-dbbf-4ff9-84ed-0ec7f14a715a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc7b30a-c746-40de-92cf-f0508037edc4', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7dc71db-bc7b-4869-989a-baf4ffe20aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Volume volume-fbc7b30a-c746-40de-92cf-f0508037edc4 (fbc7b30a-c746-40de-92cf-f0508037edc4): created successfully Jul 15 18:38:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7dc71db-bc7b-4869-989a-baf4ffe20aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Flow 'volume_create_manager' (a6a614d9-5e0f-47d4-b1be-33e2184f85f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f0246ce1-1888-40e1-a600-b641f2ccccbc tempest-TestStampPattern-596820549 None] Created volume successfully. Jul 15 18:38:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4e05e5a5-c40a-4216-a262-e9ed04795c2c tempest-GroupsTest-1148943648 None] Group tempest-GroupsTest-Group-839658834: creating Jul 15 18:38:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4e05e5a5-c40a-4216-a262-e9ed04795c2c tempest-GroupsTest-1148943648 None] Group tempest-GroupsTest-Group-839658834: created successfully Jul 15 18:38:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4e05e5a5-c40a-4216-a262-e9ed04795c2c tempest-GroupsTest-1148943648 None] Create group completed successfully. Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Flow 'volume_create_manager' (f0540e3d-eac8-43a3-997f-79b02a859efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bca6913-a3c4-4428-a4c4-df3ba514b766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bca6913-a3c4-4428-a4c4-df3ba514b766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1038558568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f353dab5-eeb3-4c59-a9e8-c530b5d7574d,host='devstack@QuobyteHD#QuobyteHD',id=29486827-845c-48c4-8172-5f296280f313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ba5e8048d54208b3c3cbf2382bbbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:40Z,use_quota=True,user_id='8e86884fedbd4a3b87622cb12dd6abc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(040ab762-1075-4c73-8865-5c7567328160),volume_type_id=040ab762-1075-4c73-8865-5c7567328160)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e2b897-6027-4b34-85e6-34e4c98534a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e2b897-6027-4b34-85e6-34e4c98534a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fab0f66-d6b9-46a1-a5cd-74847f25d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fab0f66-d6b9-46a1-a5cd-74847f25d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29486827-845c-48c4-8172-5f296280f313', 'volume_name': 'volume-29486827-845c-48c4-8172-5f296280f313', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7d002c-7c58-4f11-bfce-0859fa7225f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7d002c-7c58-4f11-bfce-0859fa7225f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4d5fe2-ec67-4818-b4df-a423319ee38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:40 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Volume 29486827-845c-48c4-8172-5f296280f313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29486827-845c-48c4-8172-5f296280f313', 'volume_size': 1} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f353dab5-eeb3-4c59-a9e8-c530b5d7574d,created_at=2026-07-15T16:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1038558568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f353dab5-eeb3-4c59-a9e8-c530b5d7574d,host='devstack@QuobyteHD#QuobyteHD',id=29486827-845c-48c4-8172-5f296280f313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ba5e8048d54208b3c3cbf2382bbbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:40Z,use_quota=True,user_id='8e86884fedbd4a3b87622cb12dd6abc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(040ab762-1075-4c73-8865-5c7567328160),volume_type_id=040ab762-1075-4c73-8865-5c7567328160)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Creating volume 29486827-845c-48c4-8172-5f296280f313 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:40 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:40 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313 1073741824 Jul 15 18:38:40 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "cinder-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "cinder-quobyte-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-quobyte-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d413325-4984-4283-8b47-5d53bf76c6da]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:40 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 Jul 15 18:38:40 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:41 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313 1073741824" returned: 0 in 0.790s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0" returned: 0 in 0.556s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:41 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:41 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0 Jul 15 18:38:41 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:41 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313 Jul 15 18:38:41 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:41 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0" returned: 0 in 0.462s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-quobyte-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0" released by "delete_volume" :: held 1.084s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:41 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313" returned: 0 in 0.513s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4d5fe2-ec67-4818-b4df-a423319ee38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29486827-845c-48c4-8172-5f296280f313', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db87aa5f-1d76-4764-b847-5d13c46127c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Created reservations ['a4a7a51b-adec-4aa3-b00f-6eeece5b7eb6', '1e7c2823-2bd8-4560-8ebf-8d39a1b1a518', '36a6811f-a720-46cc-8b06-948b167d5b0c', '8978e571-b217-4fa8-be9a-2f400f1eea23'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:41 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Volume volume-29486827-845c-48c4-8172-5f296280f313 (29486827-845c-48c4-8172-5f296280f313): created successfully Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db87aa5f-1d76-4764-b847-5d13c46127c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Flow 'volume_create_manager' (f0540e3d-eac8-43a3-997f-79b02a859efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:41 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-644d0f05-cccf-48b1-a132-76991c03f0c3 tempest-GroupsTest-1148943648 None] Created volume successfully. Jul 15 18:38:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:42 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:42 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:42 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.313s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:42 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:42 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Deleted volume successfully. Jul 15 18:38:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-63e3e37e-ac52-461f-b3e6-2ec41f8a680f tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-7bdf2b94-6a09-43ec-830c-f6a1dfcc3ce0-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "cinder-ff39ac7f-2601-42db-a595-d8fad82a60be-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-ff39ac7f-2601-42db-a595-d8fad82a60be-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "cinder-quobyte-ff39ac7f-2601-42db-a595-d8fad82a60be" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-quobyte-ff39ac7f-2601-42db-a595-d8fad82a60be" acquired by "delete_volume" :: waited 0.046s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92798cf-9606-4f24-8826-b7f94f240bad]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:43 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be Jul 15 18:38:43 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Flow 'volume_create_manager' (33c4ed7c-e425-4d68-9902-d9f075328be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713345e5-3ba8-41c4-b67c-48626947ade5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713345e5-3ba8-41c4-b67c-48626947ade5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-895400920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f353dab5-eeb3-4c59-a9e8-c530b5d7574d,host='devstack@QuobyteHD#QuobyteHD',id=ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ba5e8048d54208b3c3cbf2382bbbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:44Z,use_quota=True,user_id='8e86884fedbd4a3b87622cb12dd6abc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(040ab762-1075-4c73-8865-5c7567328160),volume_type_id=040ab762-1075-4c73-8865-5c7567328160)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ab7110-eec1-4d56-aaef-fb34561d2724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ab7110-eec1-4d56-aaef-fb34561d2724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd01fe7-dfa8-43f1-8198-9832b26d6ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd01fe7-dfa8-43f1-8198-9832b26d6ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f', 'volume_name': 'volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d073869e-e639-45c9-b616-9dd13bd5498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d073869e-e639-45c9-b616-9dd13bd5498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1456d91a-e854-4b47-b774-493a5320e5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:43 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Volume ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f', 'volume_size': 1} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f353dab5-eeb3-4c59-a9e8-c530b5d7574d,created_at=2026-07-15T16:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-895400920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f353dab5-eeb3-4c59-a9e8-c530b5d7574d,host='devstack@QuobyteHD#QuobyteHD',id=ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ba5e8048d54208b3c3cbf2382bbbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:44Z,use_quota=True,user_id='8e86884fedbd4a3b87622cb12dd6abc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(040ab762-1075-4c73-8865-5c7567328160),volume_type_id=040ab762-1075-4c73-8865-5c7567328160)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Creating volume ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:43 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:43 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f 1073741824 Jul 15 18:38:43 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:43 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be" returned: 0 in 0.619s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:43 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be Jul 15 18:38:43 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ff39ac7f-2601-42db-a595-d8fad82a60be" returned: 0 in 0.362s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:44 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-quobyte-ff39ac7f-2601-42db-a595-d8fad82a60be" released by "delete_volume" :: held 1.037s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Created reservations ['1abcaea8-d90a-4811-a0bd-cfd3dc235080', '6b1afd9d-05ff-4311-8938-e8b75ac6eaef', '69f4fccf-c2b7-4f7e-a0fa-4ddd45536f79', '0026a7bb-719d-4374-810c-bbfd22820c0c'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:44 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f 1073741824" returned: 0 in 0.697s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:44 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f Jul 15 18:38:44 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:44 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:44 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:45 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f" returned: 0 in 0.566s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1456d91a-e854-4b47-b774-493a5320e5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1425e60b-8a95-4c66-8002-84509bbddaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Volume volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f (ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f): created successfully Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1425e60b-8a95-4c66-8002-84509bbddaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Flow 'volume_create_manager' (33c4ed7c-e425-4d68-9902-d9f075328be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5195a11c-2607-4f83-883c-6d51be3917e4 tempest-GroupsTest-1148943648 None] Created volume successfully. Jul 15 18:38:45 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.667s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Flow 'volume_create_manager' (67a82f9d-c86e-48af-b196-a82af05c62a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10292d83-8e61-4ea7-8063-8201d3a3c015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Deleted volume successfully. Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10292d83-8e61-4ea7-8063-8201d3a3c015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2029170103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a255675e07746fa8e688c8afc156df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:45Z,use_quota=True,user_id='a970a1ef2e7841729f2b2ea3bcbc6fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ec9613-44cf-4117-9bd8-d1058047db7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ec9613-44cf-4117-9bd8-d1058047db7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e6ec1c-029e-4f23-9dde-80a7e4b1a1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e6ec1c-029e-4f23-9dde-80a7e4b1a1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5', 'volume_name': 'volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488d71ff-b92f-4658-b884-02505832458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488d71ff-b92f-4658-b884-02505832458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5af1aa-f273-4e43-8de2-2f4be128e199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Volume 19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5', 'volume_size': 1} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2029170103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a255675e07746fa8e688c8afc156df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:45Z,use_quota=True,user_id='a970a1ef2e7841729f2b2ea3bcbc6fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Creating volume 19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:45 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bef992e2-df85-4f60-a24b-7ffdacadd74d tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-ff39ac7f-2601-42db-a595-d8fad82a60be-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:45 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 1073741824 Jul 15 18:38:45 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "cinder-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "cinder-quobyte-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-quobyte-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:46 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e72a8a-59c7-4b54-9e6a-58c0f864ad46]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:46 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 Jul 15 18:38:46 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:46 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5" returned: 0 in 0.540s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:46 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 1073741824" returned: 0 in 0.874s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:46 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5 Jul 15 18:38:46 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:46 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d636ba74-2e98-4370-ad46-01d0cf6e6baf tempest-GroupsTest-1148943648 None] Update group completed successfully. Jul 15 18:38:46 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 Jul 15 18:38:46 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:47 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5" returned: 0 in 0.331s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-quobyte-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5" released by "delete_volume" :: held 0.923s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Created reservations ['b2fd3d3d-71f9-4781-bcaf-94d39409bb7f', 'ab82bd7d-080b-4dc0-a60e-9fbfac4e6762', '696dad7c-4654-4120-8305-7b868fde1761', '87d5fcd7-9b39-4cd7-a7c4-24fd36480de8'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:47 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5" returned: 0 in 0.332s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5af1aa-f273-4e43-8de2-2f4be128e199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be307b3-ba94-45f1-a825-72c3c22538e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:47 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Volume volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 (19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5): created successfully Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be307b3-ba94-45f1-a825-72c3c22538e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Flow 'volume_create_manager' (67a82f9d-c86e-48af-b196-a82af05c62a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:47 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8ef4522f-6a4d-41a9-8933-1fb0926bca63 tempest-VolumesNegativeTest-373377227 None] Created volume successfully. Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:47 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:47 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:47 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.698s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:47 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:47 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Deleted volume successfully. Jul 15 18:38:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd71fa4-0948-4737-86cb-d26f83ef4ec8 tempest-AttachVolumeNegativeTest-946525463 None] Lock "cinder-2b0716fe-029b-4ee2-89b5-3e9c0bdf86e5-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-371ac86c-70f2-4c61-88d2-e489640b6fcd tempest-GroupsTest-1148943648 None] Update group completed successfully. Jul 15 18:38:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Acquiring lock "cinder-quobyte-29486827-845c-48c4-8172-5f296280f313" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Lock "cinder-quobyte-29486827-845c-48c4-8172-5f296280f313" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:50 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[83836324-2131-4c35-83a2-ff124a1c62c0]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:51 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313 Jul 15 18:38:51 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:51 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313" returned: 0 in 0.675s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:51 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313 Jul 15 18:38:51 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:52 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-29486827-845c-48c4-8172-5f296280f313" returned: 0 in 0.482s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Lock "cinder-quobyte-29486827-845c-48c4-8172-5f296280f313" released by "delete_volume" :: held 1.257s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Acquiring lock "cinder-quobyte-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Lock "cinder-quobyte-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f" acquired by "delete_volume" :: waited 0.047s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:52 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4790464-8d99-4b3f-bbde-87b239eccfe4]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:52 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f Jul 15 18:38:52 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:52 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f" returned: 0 in 0.552s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:52 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f Jul 15 18:38:52 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:53 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f" returned: 0 in 0.400s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Lock "cinder-quobyte-ac6d0fa2-5dcf-4dac-a2aa-60d5e5a0163f" released by "delete_volume" :: held 1.062s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Created reservations ['78e893d9-f219-481d-883c-06bb02a53853'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:53 devstack cinder-volume[87863]: WARNING cinder.quota [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1365601678 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1365601678, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:38:53 devstack cinder-volume[87863]: WARNING cinder.quota [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1365601678 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1365601678, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Created reservations ['68e07e22-253f-422e-8208-82ed1311f773', '547b1278-b10a-4b7a-970f-8f1b89465b5c', '4523b58b-6415-45c7-84dd-d0fd581b8597', '5a741703-340d-4bc0-81cb-7761e671fc4e'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Created reservations ['3133910a-c692-4edf-8d17-472c17303e58', 'e2121ad4-e242-4f22-b9ab-4084e288ea90', 'cef00215-f96e-4d32-accc-f17d5eea6f60', 'd9018180-006d-438e-a4e7-6376e36395da'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:54 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:38:54 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:54 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.577s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:54 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-17dbd03a-9f7e-41ad-b81c-063b0dbe693e tempest-GroupsTest-1148943648 None] Delete group completed successfully. Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Flow 'volume_create_manager' (592135f7-1c04-47f4-bf4f-14ff11b580cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209f6ce2-ed8c-41e8-826d-f2e30c043295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209f6ce2-ed8c-41e8-826d-f2e30c043295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2009492487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b11e50-c2bd-4c67-ac83-a6d5ff3a603c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f6a051f05f9410c93db2c6f6abcabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:03Z,use_quota=True,user_id='3d957089421446e3bf6a3cd44bfaf97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5936858a-5ea0-43e1-b694-e1d51bc13624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5936858a-5ea0-43e1-b694-e1d51bc13624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bc9880-2009-4ee5-b140-c073e78da8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bc9880-2009-4ee5-b140-c073e78da8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b11e50-c2bd-4c67-ac83-a6d5ff3a603c', 'volume_name': 'volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61152ecb-2b0d-4595-ba7c-98a18f78d9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61152ecb-2b0d-4595-ba7c-98a18f78d9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2332c06-3252-46bd-b8a5-031f29895e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:03 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Volume 53b11e50-c2bd-4c67-ac83-a6d5ff3a603c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c', 'volume_size': 1} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2009492487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b11e50-c2bd-4c67-ac83-a6d5ff3a603c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f6a051f05f9410c93db2c6f6abcabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:03Z,use_quota=True,user_id='3d957089421446e3bf6a3cd44bfaf97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Creating volume 53b11e50-c2bd-4c67-ac83-a6d5ff3a603c {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:03 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:03 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c 1073741824 Jul 15 18:39:03 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:03 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c 1073741824" returned: 0 in 0.656s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:03 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c Jul 15 18:39:03 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:04 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c" returned: 0 in 0.355s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Flow 'volume_create_manager' (eecf8dba-fbe0-4b3e-ba78-ece2f296b7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24e2331-8295-4c43-9777-454b91a9438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2332c06-3252-46bd-b8a5-031f29895e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f675475-a78c-4aca-8824-26c7aa01cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24e2331-8295-4c43-9777-454b91a9438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-667475063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e09f423-a8af-4721-a54c-11eabb014fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6fcb590e3d4f648f0ee29284e34d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:04Z,use_quota=True,user_id='c0ecd5acf8824fc692c7328a672a68e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1babdecf-44ac-4d1e-9065-c07dbb212089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1babdecf-44ac-4d1e-9065-c07dbb212089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83601c2e-4d53-47b3-84c9-cb170d063481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83601c2e-4d53-47b3-84c9-cb170d063481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e09f423-a8af-4721-a54c-11eabb014fd4', 'volume_name': 'volume-5e09f423-a8af-4721-a54c-11eabb014fd4', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4341f58-d601-4b78-a3f7-eed12db71d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4341f58-d601-4b78-a3f7-eed12db71d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df37412-11c9-4351-8b98-131acf5221af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:04 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Volume 5e09f423-a8af-4721-a54c-11eabb014fd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e09f423-a8af-4721-a54c-11eabb014fd4', 'volume_size': 1} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-667475063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e09f423-a8af-4721-a54c-11eabb014fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6fcb590e3d4f648f0ee29284e34d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:04Z,use_quota=True,user_id='c0ecd5acf8824fc692c7328a672a68e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Creating volume 5e09f423-a8af-4721-a54c-11eabb014fd4 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:04 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:04 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Volume volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c (53b11e50-c2bd-4c67-ac83-a6d5ff3a603c): created successfully Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f675475-a78c-4aca-8824-26c7aa01cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Flow 'volume_create_manager' (592135f7-1c04-47f4-bf4f-14ff11b580cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:04 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4 1073741824 Jul 15 18:39:04 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:04 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-078072ae-329b-4f28-8bb4-ac5e2f877c09 tempest-VolumesTestJSON-97069371 None] Created volume successfully. Jul 15 18:39:04 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4 1073741824" returned: 0 in 0.471s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:04 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4 Jul 15 18:39:04 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:05 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4" returned: 0 in 0.295s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df37412-11c9-4351-8b98-131acf5221af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e09f423-a8af-4721-a54c-11eabb014fd4', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e80070-138c-44ea-aca6-1c4830f6705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:05 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Volume volume-5e09f423-a8af-4721-a54c-11eabb014fd4 (5e09f423-a8af-4721-a54c-11eabb014fd4): created successfully Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e80070-138c-44ea-aca6-1c4830f6705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Flow 'volume_create_manager' (eecf8dba-fbe0-4b3e-ba78-ece2f296b7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:05 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-72231e0f-2bde-453e-bb88-50e6d7cc21a4 tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Created volume successfully. Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Flow 'volume_create_manager' (40a7b2dd-a024-482b-ab83-76d26a318705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adbab95f-7e82-4f6e-a7b6-36db041b106d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adbab95f-7e82-4f6e-a7b6-36db041b106d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1521450766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cfe690-f22b-4c46-a532-2f9cbcc4c07a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f6a051f05f9410c93db2c6f6abcabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:06Z,use_quota=True,user_id='3d957089421446e3bf6a3cd44bfaf97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af48ae98-543d-4c54-abe9-311253d4e9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af48ae98-543d-4c54-abe9-311253d4e9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc77d8c8-21bb-4897-8f50-8c9bf8bdc106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc77d8c8-21bb-4897-8f50-8c9bf8bdc106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93cfe690-f22b-4c46-a532-2f9cbcc4c07a', 'volume_name': 'volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce686cd-63e9-420c-84e1-a6dbabcafdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce686cd-63e9-420c-84e1-a6dbabcafdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319c0441-ea04-4083-a960-12eeb6c969d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:05 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Volume 93cfe690-f22b-4c46-a532-2f9cbcc4c07a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a', 'volume_size': 1} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1521450766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cfe690-f22b-4c46-a532-2f9cbcc4c07a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f6a051f05f9410c93db2c6f6abcabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:06Z,use_quota=True,user_id='3d957089421446e3bf6a3cd44bfaf97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Creating volume 93cfe690-f22b-4c46-a532-2f9cbcc4c07a {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:05 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:39:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:05 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a 1073741824 Jul 15 18:39:05 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:06 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a 1073741824" returned: 0 in 0.591s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:06 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a Jul 15 18:39:06 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:06 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a" returned: 0 in 0.379s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319c0441-ea04-4083-a960-12eeb6c969d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8725ca75-949a-4dca-b566-11b495d0dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:06 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Volume volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a (93cfe690-f22b-4c46-a532-2f9cbcc4c07a): created successfully Jul 15 18:39:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8725ca75-949a-4dca-b566-11b495d0dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Flow 'volume_create_manager' (40a7b2dd-a024-482b-ab83-76d26a318705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5ad174b9-3210-4a99-a06f-234735c56069 tempest-VolumesTestJSON-97069371 None] Created volume successfully. Jul 15 18:39:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Acquiring lock "cinder-5e09f423-a8af-4721-a54c-11eabb014fd4-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Lock "cinder-5e09f423-a8af-4721-a54c-11eabb014fd4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Acquiring lock "cinder-quobyte-5e09f423-a8af-4721-a54c-11eabb014fd4" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Lock "cinder-quobyte-5e09f423-a8af-4721-a54c-11eabb014fd4" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[468e173c-6698-49e3-aeba-42f2fb5c65d3]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:07 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4 Jul 15 18:39:07 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:08 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4" returned: 0 in 0.502s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:08 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4 Jul 15 18:39:08 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:08 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5e09f423-a8af-4721-a54c-11eabb014fd4" returned: 0 in 0.327s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Lock "cinder-quobyte-5e09f423-a8af-4721-a54c-11eabb014fd4" released by "delete_volume" :: held 0.906s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Created reservations ['84b536f8-e9a8-400c-820e-01aeca357ec3', '7f74d60f-33fd-4dce-9fa1-834054a755a5', 'b7dca97f-f37b-4703-97e2-fa4feb23bb1b', 'be587016-3b1e-4481-9323-fca77ac55663'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:08 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Flow 'volume_create_manager' (b2eaf0bc-6631-49ae-b8b2-9a35691cccd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:08 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d738054b-0502-4ef1-85ce-20d74690a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d738054b-0502-4ef1-85ce-20d74690a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1292175920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e24337-b478-4bd3-aa56-2f748db66421,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f6a051f05f9410c93db2c6f6abcabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:09Z,use_quota=True,user_id='3d957089421446e3bf6a3cd44bfaf97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4d7496-9fa6-494d-905c-648952d9a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4d7496-9fa6-494d-905c-648952d9a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704613db-ebb4-4fe2-b058-7c67ae36ad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704613db-ebb4-4fe2-b058-7c67ae36ad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e24337-b478-4bd3-aa56-2f748db66421', 'volume_name': 'volume-61e24337-b478-4bd3-aa56-2f748db66421', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16fca46-9419-484e-b0a1-1d843d68c6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16fca46-9419-484e-b0a1-1d843d68c6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f19da5c-163a-46fa-bd2d-dcbb4a1bc57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:09 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Volume 61e24337-b478-4bd3-aa56-2f748db66421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e24337-b478-4bd3-aa56-2f748db66421', 'volume_size': 1} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1292175920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e24337-b478-4bd3-aa56-2f748db66421,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f6a051f05f9410c93db2c6f6abcabeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:09Z,use_quota=True,user_id='3d957089421446e3bf6a3cd44bfaf97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Creating volume 61e24337-b478-4bd3-aa56-2f748db66421 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:09 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:09 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421 1073741824 Jul 15 18:39:09 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:09 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.295s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:09 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Deleted volume successfully. Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5bce5d4-a505-4083-8cf9-982cd959daae tempest-VolumeQuotasNegativeTestJSON-1317354343 None] Lock "cinder-5e09f423-a8af-4721-a54c-11eabb014fd4-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:09 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421 1073741824" returned: 0 in 0.523s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:09 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421 Jul 15 18:39:09 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:09 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421" returned: 0 in 0.262s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f19da5c-163a-46fa-bd2d-dcbb4a1bc57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e24337-b478-4bd3-aa56-2f748db66421', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53404792-9c79-435d-82f0-9f0f7c1d579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:09 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Volume volume-61e24337-b478-4bd3-aa56-2f748db66421 (61e24337-b478-4bd3-aa56-2f748db66421): created successfully Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53404792-9c79-435d-82f0-9f0f7c1d579b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Flow 'volume_create_manager' (b2eaf0bc-6631-49ae-b8b2-9a35691cccd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:09 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-71026e2b-59e1-4c40-a2e3-328d7dc83663 tempest-VolumesTestJSON-97069371 None] Created volume successfully. Jul 15 18:39:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Acquiring lock "cinder-61e24337-b478-4bd3-aa56-2f748db66421-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Lock "cinder-61e24337-b478-4bd3-aa56-2f748db66421-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Acquiring lock "cinder-quobyte-61e24337-b478-4bd3-aa56-2f748db66421" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Lock "cinder-quobyte-61e24337-b478-4bd3-aa56-2f748db66421" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:12 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d4825c-b68a-43c8-8179-c0f29a11a50e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:12 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421 Jul 15 18:39:12 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:12 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421" returned: 0 in 0.505s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:12 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421 Jul 15 18:39:12 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Acquiring lock "cinder-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Lock "cinder-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Acquiring lock "cinder-quobyte-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Lock "cinder-quobyte-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71efe8b-1393-49b7-ab70-0fa61aacfc77]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:13 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-61e24337-b478-4bd3-aa56-2f748db66421" returned: 0 in 0.412s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Lock "cinder-quobyte-61e24337-b478-4bd3-aa56-2f748db66421" released by "delete_volume" :: held 0.982s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:13 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 Jul 15 18:39:13 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Created reservations ['cccedb6d-ff09-4dd7-b205-3b13854d7169', '76aa5cf3-3c23-4dce-b90f-deaab8509b66', '8d9a2b3a-aab5-47a6-9a5a-c8161dd30a1c', '8fcd2a0d-8518-4c15-b204-ba853d3209d9'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:13 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:39:13 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:13 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5" returned: 0 in 0.544s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:13 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5 Jul 15 18:39:13 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:13 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.351s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:13 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Deleted volume successfully. Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5425e7a-dc97-4880-a453-1b5995935004 tempest-VolumesTestJSON-97069371 None] Lock "cinder-61e24337-b478-4bd3-aa56-2f748db66421-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-edaf7158-997f-4049-8b04-5d0bfd7f47e0 req-802fe56e-749a-4435-a7dc-5a6caa535172 tempest-TestStampPattern-596820549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-edaf7158-997f-4049-8b04-5d0bfd7f47e0 req-802fe56e-749a-4435-a7dc-5a6caa535172 tempest-TestStampPattern-596820549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[62089b2c-009c-40f8-8909-3781ad6ae4a2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-edaf7158-997f-4049-8b04-5d0bfd7f47e0 req-802fe56e-749a-4435-a7dc-5a6caa535172 tempest-TestStampPattern-596820549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:13 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5" returned: 0 in 0.296s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Lock "cinder-quobyte-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5" released by "delete_volume" :: held 0.917s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:14 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 Jul 15 18:39:14 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Created reservations ['e45c82fd-aa97-4dab-8fec-5fbaaa811b8c', '46567e42-0a46-4c1b-9003-9b68c57ea114', '20c58fc3-ad84-4165-a728-4ade97f5370e', '2581afa7-d200-4eb5-b6cd-9b5e456f50d2'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:14 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:39:14 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:14 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-edaf7158-997f-4049-8b04-5d0bfd7f47e0 req-802fe56e-749a-4435-a7dc-5a6caa535172 tempest-TestStampPattern-596820549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4" returned: 0 in 0.457s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-edaf7158-997f-4049-8b04-5d0bfd7f47e0 req-802fe56e-749a-4435-a7dc-5a6caa535172 tempest-TestStampPattern-596820549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.484s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-edaf7158-997f-4049-8b04-5d0bfd7f47e0 req-802fe56e-749a-4435-a7dc-5a6caa535172 tempest-TestStampPattern-596820549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-fbc7b30a-c746-40de-92cf-f0508037edc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7e8d6e1-b608-43fb-bc12-f8fde8e076c5', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Acquiring lock "cinder-93cfe690-f22b-4c46-a532-2f9cbcc4c07a-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:14 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Lock "cinder-93cfe690-f22b-4c46-a532-2f9cbcc4c07a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.313s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:14 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Deleted volume successfully. Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Acquiring lock "cinder-quobyte-93cfe690-f22b-4c46-a532-2f9cbcc4c07a" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:14 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-edaf7158-997f-4049-8b04-5d0bfd7f47e0 req-802fe56e-749a-4435-a7dc-5a6caa535172 tempest-TestStampPattern-596820549 None] attachment_update completed successfully. Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ae817f6b-52c7-4461-a1f0-bda348e956c4 tempest-VolumesNegativeTest-373377227 None] Lock "cinder-19a0b2fd-60cb-4b49-a8b8-c434f16fd6f5-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Lock "cinder-quobyte-93cfe690-f22b-4c46-a532-2f9cbcc4c07a" acquired by "delete_volume" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad9162-c38d-4e8c-829d-3bba19844e2c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:14 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a Jul 15 18:39:14 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:15 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a" returned: 0 in 0.479s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:15 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a Jul 15 18:39:15 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:15 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93cfe690-f22b-4c46-a532-2f9cbcc4c07a" returned: 0 in 0.337s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Lock "cinder-quobyte-93cfe690-f22b-4c46-a532-2f9cbcc4c07a" released by "delete_volume" :: held 0.903s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Created reservations ['ca802eaf-3830-4198-ae73-0ee0d5897d3d', '9937469d-df82-4aa5-8350-a35479f5b7ae', 'da789a24-3f22-43f9-8f89-68595eb40db1', '9dd286d3-d51f-4dff-8c72-2744fa2577f7'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:15 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:39:15 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:16 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.336s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:16 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:16 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Deleted volume successfully. Jul 15 18:39:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c431314-1eae-498e-b619-3e8b2e921b98 tempest-VolumesTestJSON-97069371 None] Lock "cinder-93cfe690-f22b-4c46-a532-2f9cbcc4c07a-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Acquiring lock "cinder-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Lock "cinder-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Acquiring lock "cinder-quobyte-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Lock "cinder-quobyte-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:16 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e8dabe-5dfc-40b3-87d5-c5c9efc93009]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:17 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c Jul 15 18:39:17 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:17 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c" returned: 0 in 0.547s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:17 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c Jul 15 18:39:17 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:17 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c" returned: 0 in 0.348s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Lock "cinder-quobyte-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c" released by "delete_volume" :: held 0.975s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:17 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Created reservations ['43b1e7f3-4c86-441f-883b-bc238127fa93', 'b049553c-0b84-4068-a337-8585d3513ba1', '9cd8b57a-e8f9-4f27-a957-ddc6af1772fb', 'ef47945c-eed8-4152-8376-e5fa3f3b5bf0'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:18 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:39:18 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:18 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.363s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:18 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:18 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Deleted volume successfully. Jul 15 18:39:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cdf8df54-fbed-4832-99f9-58060dcddf3c tempest-VolumesTestJSON-97069371 None] Lock "cinder-53b11e50-c2bd-4c67-ac83-a6d5ff3a603c-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-00705fa9-f9db-45bc-b864-8c96c2f121d1 req-8ae6ddce-582f-41a2-9cb1-76d0496d6aca tempest-TestStampPattern-596820549 None] Terminate volume connection completed successfully. Jul 15 18:39:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-00705fa9-f9db-45bc-b864-8c96c2f121d1 req-8ae6ddce-582f-41a2-9cb1-76d0496d6aca tempest-TestStampPattern-596820549 None] Deleting attachment c7e8d6e1-b608-43fb-bc12-f8fde8e076c5. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:39:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Creating offline snapshot e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 of volume fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:39:21 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e08b0e-1f37-4d56-aba8-415354f84df0]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:22 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 Jul 15 18:39:22 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:22 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4" returned: 0 in 0.498s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:22 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 1G Jul 15 18:39:22 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:23 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 1G" returned: 0 in 0.657s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc7b30a-c746-40de-92cf-f0508037edc4 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:23 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc7b30a-c746-40de-92cf-f0508037edc4 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 Jul 15 18:39:23 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:23 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc7b30a-c746-40de-92cf-f0508037edc4 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1" returned: 0 in 0.473s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:23 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 is being set with open permissions: ugo+rw Jul 15 18:39:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:23 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 Jul 15 18:39:23 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:23 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1" returned: 0 in 0.318s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:23 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.info Jul 15 18:39:23 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:24 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.info" returned: 0 in 0.353s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:24 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.info is being set with open permissions: ugo+rw Jul 15 18:39:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:24 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.info Jul 15 18:39:24 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e8b0c5-418d-4280-b2fa-93a8f54e2907 tempest-BackendsCapabilitiesAdminTestsJSON-1648539895 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6894493103027, 'free_capacity_gb': 1775.6894493103027, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 15 18:39:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85da057f-76d5-4520-a66d-0ead4e35f8fa tempest-BackendsCapabilitiesAdminTestsJSON-1648539895 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6894493103027, 'free_capacity_gb': 1775.6894493103027, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 15 18:39:24 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.info" returned: 0 in 0.370s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:24 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=120,cinder:UPDATE=153,cinder:DELETE=11,cinder:INSERT=31 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:39:24 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=152,cinder:SELECT=134,cinder:INSERT=36,cinder:DELETE=9 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:39:24 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4dec78bd-d814-4616-afa9-71f10efc42e4 tempest-TestStampPattern-596820549 None] Create snapshot completed successfully Jul 15 18:39:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-01e0b596-8c7c-4eb4-a4b4-d417dd5f8c57 tempest-GroupsV314Test-596453995 None] Group tempest-GroupsV314Test-Group-732892319: creating Jul 15 18:39:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-01e0b596-8c7c-4eb4-a4b4-d417dd5f8c57 tempest-GroupsV314Test-596453995 None] Group tempest-GroupsV314Test-Group-732892319: created successfully Jul 15 18:39:34 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-01e0b596-8c7c-4eb4-a4b4-d417dd5f8c57 tempest-GroupsV314Test-596453995 None] Create group completed successfully. Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Flow 'volume_create_manager' (e5e528f3-c1e9-46c3-b44c-e9fd8d445fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78070c32-a904-40ac-ac2a-16035eb34bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78070c32-a904-40ac-ac2a-16035eb34bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-539429137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4237c1b8-2e6a-408f-990e-a2cc0bb12628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598e16f4e73240efbba84c525a8b437e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4d8e02d-4624-4d1b-ad47-dfa4862d20a1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:35Z,use_quota=True,user_id='82f0be5d0b5d48fa9d8f85fd3c411fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe627723-ad74-4ee1-9556-812b76cba4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe627723-ad74-4ee1-9556-812b76cba4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d9414d-933f-4740-bfa4-dc9af65cae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d9414d-933f-4740-bfa4-dc9af65cae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4237c1b8-2e6a-408f-990e-a2cc0bb12628', 'volume_name': 'volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628', 'volume_size': 1, 'snapshot_id': 'e4d8e02d-4624-4d1b-ad47-dfa4862d20a1'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a36f29-fe00-4876-9a06-85ad87d6537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a36f29-fe00-4876-9a06-85ad87d6537d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6f0b08-2d05-4b44-aca2-4cf6a2333812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:34 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Volume 4237c1b8-2e6a-408f-990e-a2cc0bb12628: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628', 'volume_size': 1, 'snapshot_id': 'e4d8e02d-4624-4d1b-ad47-dfa4862d20a1'} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Acquiring lock "cinder-quobyte-e4d8e02d-4624-4d1b-ad47-dfa4862d20a1-4237c1b8-2e6a-408f-990e-a2cc0bb12628" by "_create_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-e4d8e02d-4624-4d1b-ad47-dfa4862d20a1-4237c1b8-2e6a-408f-990e-a2cc0bb12628" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Creating volume 4237c1b8-2e6a-408f-990e-a2cc0bb12628 from snapshot e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 {{(pid=87863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Acquiring lock "cinder-quobyte-4237c1b8-2e6a-408f-990e-a2cc0bb12628" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-4237c1b8-2e6a-408f-990e-a2cc0bb12628" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] snapshot: e4d8e02d-4624-4d1b-ad47-dfa4862d20a1, volume: 4237c1b8-2e6a-408f-990e-a2cc0bb12628, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd31a6-a317-4857-b0c2-9fd5f64ad50c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:35 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 Jul 15 18:39:35 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:35 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:39:35 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:35 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1" returned: 0 in 0.673s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbc7b30a-c746-40de-92cf-f0508037edc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeac354a-d3b1-47e0-8218-45e8e1d3d565]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:35 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.781s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:39:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:39:36 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 Jul 15 18:39:36 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Flow 'volume_create_manager' (02008869-1b0f-4f2c-b36b-d5eec2d8e5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90d9154-f744-4710-88e5-9daa80305171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90d9154-f744-4710-88e5-9daa80305171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1217559259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ff96d15-c389-4d4f-9238-1a80c88b4fc0,host='devstack@QuobyteHD#QuobyteHD',id=bc57955c-7f1c-47d2-9a13-7b281610f3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c8b7bd1269145eba3910ca1be4ffa7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:36Z,use_quota=True,user_id='cf747f806370438e83e9b3fae0a8e9ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcb55735-f0ed-4d15-bb56-a9fae3d5fee4),volume_type_id=bcb55735-f0ed-4d15-bb56-a9fae3d5fee4)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6048b1-1b7e-422b-93e8-55fa91310f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6048b1-1b7e-422b-93e8-55fa91310f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ddd6df-d0ed-4310-b6f3-8b923aa161af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ddd6df-d0ed-4310-b6f3-8b923aa161af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc57955c-7f1c-47d2-9a13-7b281610f3e4', 'volume_name': 'volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858d1572-4571-4e2d-a139-8686a0567ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858d1572-4571-4e2d-a139-8686a0567ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9b23ab-cc86-4cbb-9253-09a844871e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:36 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Volume bc57955c-7f1c-47d2-9a13-7b281610f3e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4', 'volume_size': 1} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:36 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4" returned: 0 in 0.858s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:39:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:36 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 Jul 15 18:39:36 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Flow 'volume_create_manager' (4ee505df-f88b-416b-aafe-061aa16c0a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35abac03-3b19-4eed-86a7-b86ce62ba237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35abac03-3b19-4eed-86a7-b86ce62ba237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2125747812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89e32bb-a592-4b1c-a95a-56123f8d8e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1277b2d279454b7fb84bb70387ca2f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:37Z,use_quota=True,user_id='48349c3a9f574a56ae3ef249e151c5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306d1995-ac6b-407e-916a-c538cfb1c2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306d1995-ac6b-407e-916a-c538cfb1c2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285f6881-b5f5-4932-a889-2fd6aa86cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285f6881-b5f5-4932-a889-2fd6aa86cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89e32bb-a592-4b1c-a95a-56123f8d8e46', 'volume_name': 'volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935b2608-ff08-4b0d-950d-ed8f565c0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935b2608-ff08-4b0d-950d-ed8f565c0036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3de43f-28e9-4f59-b62d-08cafb1ca2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Volume a89e32bb-a592-4b1c-a95a-56123f8d8e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46', 'volume_size': 1} Jul 15 18:39:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:43 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628" returned: 0 in 7.342s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:44 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6a9f0c-93ba-4d8b-9d80-1c1b03898f14]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:44 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 Jul 15 18:39:44 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:44 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4" returned: 0 in 0.914s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:44 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:39:44 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Converted 1024.00 MB image at 139.44 MB/s Jul 15 18:39:44 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 is being set with open permissions: ugo+rw Jul 15 18:39:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:44 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 Jul 15 18:39:44 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:45 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628" returned: 0 in 0.477s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-4237c1b8-2e6a-408f-990e-a2cc0bb12628" released by "_copy_volume_from_snapshot" :: held 10.474s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-e4d8e02d-4624-4d1b-ad47-dfa4862d20a1-4237c1b8-2e6a-408f-990e-a2cc0bb12628" released by "_create_volume_from_snapshot" :: held 10.519s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.549s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.961s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ff96d15-c389-4d4f-9238-1a80c88b4fc0,created_at=2026-07-15T16:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1217559259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ff96d15-c389-4d4f-9238-1a80c88b4fc0,host='devstack@QuobyteHD#QuobyteHD',id=bc57955c-7f1c-47d2-9a13-7b281610f3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c8b7bd1269145eba3910ca1be4ffa7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:36Z,use_quota=True,user_id='cf747f806370438e83e9b3fae0a8e9ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcb55735-f0ed-4d15-bb56-a9fae3d5fee4),volume_type_id=bcb55735-f0ed-4d15-bb56-a9fae3d5fee4)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Creating volume bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:45 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:45 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 1073741824 Jul 15 18:39:45 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6f0b08-2d05-4b44-aca2-4cf6a2333812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628', 'volume_size': 1, 'snapshot_id': 'e4d8e02d-4624-4d1b-ad47-dfa4862d20a1'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47959bb4-b3b9-4bfa-a57e-0a3f410736c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Volume volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 (4237c1b8-2e6a-408f-990e-a2cc0bb12628): created successfully Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47959bb4-b3b9-4bfa-a57e-0a3f410736c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Flow 'volume_create_manager' (e5e528f3-c1e9-46c3-b44c-e9fd8d445fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-90c82a3d-65e0-4540-a36f-96ba18e8068b tempest-TestStampPattern-596820549 None] Created volume successfully. Jul 15 18:39:46 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 1073741824" returned: 0 in 0.750s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:46 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 Jul 15 18:39:46 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:46 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4" returned: 0 in 0.380s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.138s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2125747812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89e32bb-a592-4b1c-a95a-56123f8d8e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1277b2d279454b7fb84bb70387ca2f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:37Z,use_quota=True,user_id='48349c3a9f574a56ae3ef249e151c5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Creating volume a89e32bb-a592-4b1c-a95a-56123f8d8e46 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:46 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9b23ab-cc86-4cbb-9253-09a844871e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:46 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46 1073741824 Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b41c2f3-2dad-4cfd-adc4-c7e19a40a3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:46 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:46 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Volume volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 (bc57955c-7f1c-47d2-9a13-7b281610f3e4): created successfully Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b41c2f3-2dad-4cfd-adc4-c7e19a40a3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Flow 'volume_create_manager' (02008869-1b0f-4f2c-b36b-d5eec2d8e5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:46 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-486ccac2-4275-49e5-8a6e-2c535f0f1872 tempest-GroupsV314Test-596453995 None] Created volume successfully. Jul 15 18:39:47 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46 1073741824" returned: 0 in 0.669s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:47 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46 Jul 15 18:39:47 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:48 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46" returned: 0 in 0.593s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3de43f-28e9-4f59-b62d-08cafb1ca2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431aef2c-7832-4b79-9757-a57d6d416b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:48 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Volume volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46 (a89e32bb-a592-4b1c-a95a-56123f8d8e46): created successfully Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431aef2c-7832-4b79-9757-a57d6d416b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Flow 'volume_create_manager' (4ee505df-f88b-416b-aafe-061aa16c0a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-81908db4-3be2-4066-8fe3-de51015f9475 tempest-VolumesTransfersV355Test-1993831608 None] Created volume successfully. Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:48 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Cloning volume bc57955c-7f1c-47d2-9a13-7b281610f3e4 to volume 3984dc0b-f371-43aa-afa1-201145efd97c Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Creating offline snapshot 807a829c-2ed1-4095-9c67-a740aebb716f of volume bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3d5479-df9d-49ae-9957-9bd936b63531]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:48 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 Jul 15 18:39:48 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:49 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4" returned: 0 in 0.835s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:49 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f 1G Jul 15 18:39:49 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:50 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f 1G" returned: 0 in 1.150s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:50 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f Jul 15 18:39:50 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2329d5b8-2beb-4d3b-aea0-927f59a817ae tempest-VolumesTransfersV355Test-1229721771 None] Transfer volume completed successfully. Jul 15 18:39:51 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f" returned: 0 in 0.879s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:51 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:39:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:51 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f Jul 15 18:39:51 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:51 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f" returned: 0 in 0.390s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:51 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.info Jul 15 18:39:51 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Acquiring lock "cinder-a89e32bb-a592-4b1c-a95a-56123f8d8e46-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Lock "cinder-a89e32bb-a592-4b1c-a95a-56123f8d8e46-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:52 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.info" returned: 0 in 0.633s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:52 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:39:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:52 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.info Jul 15 18:39:52 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Acquiring lock "cinder-quobyte-a89e32bb-a592-4b1c-a95a-56123f8d8e46" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Lock "cinder-quobyte-a89e32bb-a592-4b1c-a95a-56123f8d8e46" acquired by "delete_volume" :: waited 0.052s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:52 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c0a67-9860-4f45-a381-67d79666e9e8]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:52 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46 Jul 15 18:39:52 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:53 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.info" returned: 0 in 0.616s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Acquiring lock "cinder-quobyte-3984dc0b-f371-43aa-afa1-201145efd97c" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Lock "cinder-quobyte-3984dc0b-f371-43aa-afa1-201145efd97c" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] snapshot: 807a829c-2ed1-4095-9c67-a740aebb716f, volume: 3984dc0b-f371-43aa-afa1-201145efd97c, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54d8259-7556-43e8-b534-f28b5134f0e2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:53 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46" returned: 0 in 0.820s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:53 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f Jul 15 18:39:53 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:53 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46 Jul 15 18:39:53 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:54 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a89e32bb-a592-4b1c-a95a-56123f8d8e46" returned: 0 in 0.525s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Lock "cinder-quobyte-a89e32bb-a592-4b1c-a95a-56123f8d8e46" released by "delete_volume" :: held 1.453s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Created reservations ['05d37a24-3602-4188-8666-adb61949ef39', 'ae9ceab5-1ac0-43ee-af9f-9e902437a220', '1af25653-3fd6-4260-b685-6f6c779ecd30', '49933bbb-dd04-40ac-8b99-65fcfb652158'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:54 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f" returned: 0 in 1.017s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c31cc6-cf4e-43ac-9a77-429cbe295a0a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:54 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:39:54 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:54 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 Jul 15 18:39:54 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:54 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.381s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Deleted volume successfully. Jul 15 18:39:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1460d5da-20ac-4a56-a111-102aeb3403c8 tempest-VolumesTransfersV355Test-2096067097 None] Lock "cinder-a89e32bb-a592-4b1c-a95a-56123f8d8e46-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:55 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4" returned: 0 in 0.688s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:55 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:39:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:55 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c Jul 15 18:39:55 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Flow 'volume_create_manager' (f6ecb82e-80ac-43b8-85c0-43ff83af8408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a222f5-ebcb-43ad-afe7-7ee302d7481d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a222f5-ebcb-43ad-afe7-7ee302d7481d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-734314105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599c67a8-8d7f-4e3e-b473-c4478ac1ed15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1277b2d279454b7fb84bb70387ca2f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:56Z,use_quota=True,user_id='48349c3a9f574a56ae3ef249e151c5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46a0be8-4029-4d1d-9911-97d5fd53627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46a0be8-4029-4d1d-9911-97d5fd53627e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597be14c-a0ba-4fc3-aaad-7ede6528887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597be14c-a0ba-4fc3-aaad-7ede6528887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599c67a8-8d7f-4e3e-b473-c4478ac1ed15', 'volume_name': 'volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb45d282-aa14-4420-ae29-44a3d1436c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb45d282-aa14-4420-ae29-44a3d1436c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f81c8e-debd-49e1-9da7-6c30edfdd61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:56 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Volume 599c67a8-8d7f-4e3e-b473-c4478ac1ed15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15', 'volume_size': 1} Jul 15 18:39:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:03 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c" returned: 0 in 8.157s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:03 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb4c1fc-8c99-4ee5-8f2c-087603b078f7]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:03 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 Jul 15 18:40:03 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:04 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4" returned: 0 in 0.933s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:40:04 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Converted 1024.00 MB image at 125.50 MB/s Jul 15 18:40:04 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:04 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c Jul 15 18:40:04 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:04 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c" returned: 0 in 0.509s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Lock "cinder-quobyte-3984dc0b-f371-43aa-afa1-201145efd97c" released by "_copy_volume_from_snapshot" :: held 11.496s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Acquiring lock "cinder-quobyte-807a829c-2ed1-4095-9c67-a740aebb716f" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Lock "cinder-quobyte-807a829c-2ed1-4095-9c67-a740aebb716f" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Deleting offline snapshot 807a829c-2ed1-4095-9c67-a740aebb716f of volume bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] snapshot_file for this snap is: volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb4c781-1572-4d9a-a905-ed8ab5fa6b0d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:05 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f Jul 15 18:40:05 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:05 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f" returned: 0 in 0.497s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6c7797-177a-4385-8c1d-159cf64d3174]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:05 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 Jul 15 18:40:05 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:05 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4" returned: 0 in 0.451s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:05 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f Jul 15 18:40:05 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:06 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f" returned: 0 in 0.392s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:06 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f Jul 15 18:40:06 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:DELETE=2,cinder:SELECT=20,cinder:UPDATE=15,cinder:INSERT=3 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:40:06 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4.807a829c-2ed1-4095-9c67-a740aebb716f" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Lock "cinder-quobyte-807a829c-2ed1-4095-9c67-a740aebb716f" released by "_delete_snapshot" :: held 1.819s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.232s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.189s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-734314105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599c67a8-8d7f-4e3e-b473-c4478ac1ed15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1277b2d279454b7fb84bb70387ca2f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:56Z,use_quota=True,user_id='48349c3a9f574a56ae3ef249e151c5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Creating volume 599c67a8-8d7f-4e3e-b473-c4478ac1ed15 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:06 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:40:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:06 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15 1073741824 Jul 15 18:40:06 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-02c97ab7-048e-4c20-bd34-344c91a6bb37 tempest-GroupsV314Test-596453995 None] Create group from source-group-3ff96d15-c389-4d4f-9238-1a80c88b4fc0 completed successfully. Jul 15 18:40:07 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15 1073741824" returned: 0 in 0.518s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:40:07 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15 Jul 15 18:40:07 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Flow 'volume_create_manager' (f754527c-cc11-4380-b857-c58e6391e1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da41fba6-7aa1-4702-a970-60bb66673a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da41fba6-7aa1-4702-a970-60bb66673a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2071056169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f28ca00-0808-4189-975c-73474f4ef2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb9357275834770ac39e0496f69efab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:07Z,use_quota=True,user_id='2f140bd4eb19497ea90db1403c4f44af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e13427d-6574-443d-aa7d-32861fd251c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e13427d-6574-443d-aa7d-32861fd251c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736d5d3c-e04f-477f-a811-66e0bde6a941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.image.glance [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Creating Keystone auth plugin from conf {{(pid=87863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:40:07 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15" returned: 0 in 0.296s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f81c8e-debd-49e1-9da7-6c30edfdd61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ba3aca-6c08-4f1e-b747-491a32890746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:07 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Volume volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15 (599c67a8-8d7f-4e3e-b473-c4478ac1ed15): created successfully Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ba3aca-6c08-4f1e-b747-491a32890746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Flow 'volume_create_manager' (f6ecb82e-80ac-43b8-85c0-43ff83af8408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:07 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-32cd7714-ac0e-4b60-82ce-44b548a718cc tempest-VolumesTransfersV355Test-1993831608 None] Created volume successfully. Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Acquiring lock "cinder-quobyte-3984dc0b-f371-43aa-afa1-201145efd97c" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Lock "cinder-quobyte-3984dc0b-f371-43aa-afa1-201145efd97c" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2540d29-a35f-4d28-b1a2-4f71a4c58010]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736d5d3c-e04f-477f-a811-66e0bde6a941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f28ca00-0808-4189-975c-73474f4ef2a6', 'volume_name': 'volume-5f28ca00-0808-4189-975c-73474f4ef2a6', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db35261-81c0-487e-a56b-04c24505658d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db35261-81c0-487e-a56b-04c24505658d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78213020-7d74-4bbd-b0ad-4273133c9054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:07 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Volume 5f28ca00-0808-4189-975c-73474f4ef2a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f28ca00-0808-4189-975c-73474f4ef2a6', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 15 18:40:07 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Trying to clone 5f28ca00-0808-4189-975c-73474f4ef2a6 from image 26627af3-14a2-4924-a235-ca96adb6f0af at location (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]). {{(pid=87863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:40:08 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c Jul 15 18:40:08 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Acquiring lock "cinder-599c67a8-8d7f-4e3e-b473-c4478ac1ed15-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Lock "cinder-599c67a8-8d7f-4e3e-b473-c4478ac1ed15-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Acquiring lock "cinder-quobyte-599c67a8-8d7f-4e3e-b473-c4478ac1ed15" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Lock "cinder-quobyte-599c67a8-8d7f-4e3e-b473-c4478ac1ed15" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[169ec41e-b82c-4cd2-aa74-22d6b3ed8b17]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:08 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c" returned: 0 in 0.482s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:08 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c Jul 15 18:40:08 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:40:08 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Image download 20.69 MB at 20.69 MB/s Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a925061e-1785-4deb-a4e0-01fc429b1f82]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:08 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15 Jul 15 18:40:08 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:08 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD Jul 15 18:40:08 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:08 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3984dc0b-f371-43aa-afa1-201145efd97c" returned: 0 in 0.267s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Lock "cinder-quobyte-3984dc0b-f371-43aa-afa1-201145efd97c" released by "delete_volume" :: held 0.825s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Created reservations ['3a8b71db-c554-4313-9a7f-8e26f43561ec'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:08 devstack cinder-volume[87863]: WARNING cinder.quota [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-969715486 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-969715486, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:40:08 devstack cinder-volume[87863]: WARNING cinder.quota [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-969715486 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-969715486, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:40:08 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15" returned: 0 in 0.425s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:08 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15 Jul 15 18:40:08 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Created reservations ['788ebe45-9073-4a23-892b-5e8ba7ede278', '74efc59f-13a1-4955-b7d0-d0bdbb1d60ee', 'b066211d-7e51-4db4-a855-1f8cfcdd8101', '63204e8e-bcb4-4f60-9662-5b25134c3085'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:08 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Temporary image 26627af3-14a2-4924-a235-ca96adb6f0af is fetched for user 2f140bd4eb19497ea90db1403c4f44af. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3ad26-2b23-4487-bff1-694764ae6a34]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:08 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:40:08 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:09 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD Jul 15 18:40:09 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:09 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-599c67a8-8d7f-4e3e-b473-c4478ac1ed15" returned: 0 in 0.321s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Lock "cinder-quobyte-599c67a8-8d7f-4e3e-b473-c4478ac1ed15" released by "delete_volume" :: held 0.808s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Created reservations ['f363bf60-011e-43a7-80a0-3888cb64bb42', '05ab9634-88c2-46a2-90e4-e6bb4db4076e', '6b86b646-8617-4d85-ac74-4b0269b22cff', '4db8adc7-fb48-47a0-a246-0a434c5abe5f'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:09 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.392s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:09 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:09 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f8331339-f5c0-4d4f-b4a0-8a0307db9615 tempest-GroupsV314Test-596453995 None] Delete group completed successfully. Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2071056169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f28ca00-0808-4189-975c-73474f4ef2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb9357275834770ac39e0496f69efab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:07Z,use_quota=True,user_id='2f140bd4eb19497ea90db1403c4f44af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Creating volume 5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:09 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Acquiring lock "cinder-quobyte-bc57955c-7f1c-47d2-9a13-7b281610f3e4" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:09 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 1073741824 Jul 15 18:40:09 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:09 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:40:09 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Lock "cinder-quobyte-bc57955c-7f1c-47d2-9a13-7b281610f3e4" acquired by "delete_volume" :: waited 0.067s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4f4d9e-b1c2-494b-8ab3-c4d50b30e239]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:09 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 Jul 15 18:40:09 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:09 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.326s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:09 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Deleted volume successfully. Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8403845b-6ffc-4809-883d-a51cf67facdd tempest-VolumesTransfersV355Test-2096067097 None] Lock "cinder-599c67a8-8d7f-4e3e-b473-c4478ac1ed15-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:09 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4" returned: 0 in 0.429s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:10 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 1073741824" returned: 0 in 0.614s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:10 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4 Jul 15 18:40:10 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:10 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:40:10 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:10 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-bc57955c-7f1c-47d2-9a13-7b281610f3e4" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Lock "cinder-quobyte-bc57955c-7f1c-47d2-9a13-7b281610f3e4" released by "delete_volume" :: held 0.806s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:10 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 0 in 0.292s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Attempting download of 26627af3-14a2-4924-a235-ca96adb6f0af ((None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}])) to volume 5f28ca00-0808-4189-975c-73474f4ef2a6. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Created reservations ['1bb77eea-6a11-42f9-9b71-78057b45704b'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8395d1-7298-4539-a754-38e9188c6c47]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_sfaymj5v {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Created reservations ['21585e15-c953-47dc-b22b-2714e8bca2c3', 'c9db230f-b547-4a09-95a8-f71a5b96b033', '2480bfbb-60a0-4c64-aace-2a3d64b76e68', 'ff45a8ef-6f8c-42eb-a7a7-d17b2c72d2c3'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:10 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_sfaymj5v Jul 15 18:40:10 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:10 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:40:10 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:10 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_sfaymj5v" returned: 0 in 0.403s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_sfaymj5v {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:10 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.269s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:10 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:10 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ed4d8825-19ab-48ab-94b9-60a40f56b521 tempest-GroupsV314Test-596453995 None] Delete group completed successfully. Jul 15 18:40:11 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_sfaymj5v Jul 15 18:40:11 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:11 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_sfaymj5v" returned: 1 in 0.399s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26627af3-14a2-4924-a235-ca96adb6f0af_sfaymj5v' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:40:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a611ca-3d95-49b3-8857-4e0a31ced536]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:11 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD Jul 15 18:40:11 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:11 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:11 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] 26627af3-14a2-4924-a235-ca96adb6f0af was qcow2, converting to raw {{(pid=87863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:40:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:11 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:40:11 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:13 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 0 in 1.992s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:13 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26627af3-14a2-4924-a235-ca96adb6f0af_oqrzlji1devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:40:13 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Converted 112.00 MB image at 56.17 MB/s Jul 15 18:40:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:13 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 1G Jul 15 18:40:13 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:14 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 1G" returned: 0 in 0.380s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0bba17-1b2f-43ab-80b5-8ace0aba49e4]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:14 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:40:14 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:14 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 0 in 0.439s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:14 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:40:14 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:15 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 1 in 0.449s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Downloaded image 26627af3-14a2-4924-a235-ca96adb6f0af ((None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}])) to volume 5f28ca00-0808-4189-975c-73474f4ef2a6 successfully. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Temporary image 26627af3-14a2-4924-a235-ca96adb6f0af for user 2f140bd4eb19497ea90db1403c4f44af is deleted. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Marking volume 5f28ca00-0808-4189-975c-73474f4ef2a6 as bootable. {{(pid=87863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Copying metadata from image 26627af3-14a2-4924-a235-ca96adb6f0af to 5f28ca00-0808-4189-975c-73474f4ef2a6. {{(pid=87863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Creating volume glance metadata for volume 5f28ca00-0808-4189-975c-73474f4ef2a6 backed by image 26627af3-14a2-4924-a235-ca96adb6f0af with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78213020-7d74-4bbd-b0ad-4273133c9054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f28ca00-0808-4189-975c-73474f4ef2a6', 'volume_size': 1, 'image_id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26627af3-14a2-4924-a235-ca96adb6f0af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8392f1b03fc425b993a86d35199e1ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26627af3-14a2-4924-a235-ca96adb6f0af', 'created_at': datetime.datetime(2026, 7, 15, 16, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26627af3-14a2-4924-a235-ca96adb6f0af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02856d90-8902-44a8-9a0a-187e112d7027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:15 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Volume volume-5f28ca00-0808-4189-975c-73474f4ef2a6 (5f28ca00-0808-4189-975c-73474f4ef2a6): created successfully Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02856d90-8902-44a8-9a0a-187e112d7027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Flow 'volume_create_manager' (f754527c-cc11-4380-b857-c58e6391e1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:15 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-62deaf9f-a500-4c02-9feb-dcd275790716 tempest-TestShelveInstance-642695930 None] Created volume successfully. Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Flow 'volume_create_manager' (ca3ecc32-0ff2-482a-9b9a-cee1d1310c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd8b455-1760-4db9-a79f-d5ec63d0f429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd8b455-1760-4db9-a79f-d5ec63d0f429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2062666322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f64b965-cbb4-405f-81a4-a2dd64eabde6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebf572bf3b84fb793727252581d53fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:19Z,use_quota=True,user_id='6f03137eab9f4484b3107217a0867af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16e20d7-7064-4d91-99b2-571e3245f692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16e20d7-7064-4d91-99b2-571e3245f692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cfa7d8-4502-4426-85b6-ef35010e54f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cfa7d8-4502-4426-85b6-ef35010e54f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f64b965-cbb4-405f-81a4-a2dd64eabde6', 'volume_name': 'volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad680676-cf3f-4552-b07a-ba543f51a5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad680676-cf3f-4552-b07a-ba543f51a5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9abc71f-6abf-46b1-8fa0-9352b5742229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:18 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Volume 2f64b965-cbb4-405f-81a4-a2dd64eabde6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6', 'volume_size': 1} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2062666322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f64b965-cbb4-405f-81a4-a2dd64eabde6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebf572bf3b84fb793727252581d53fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:19Z,use_quota=True,user_id='6f03137eab9f4484b3107217a0867af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Creating volume 2f64b965-cbb4-405f-81a4-a2dd64eabde6 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:18 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:40:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:18 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6 1073741824 Jul 15 18:40:19 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:19 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7ac35952-72a4-42d4-aa94-70575e251bb1 tempest-GroupsV320Test-2057280708 None] Group tempest-GroupsV320Test-Group-407886607: creating Jul 15 18:40:19 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7ac35952-72a4-42d4-aa94-70575e251bb1 tempest-GroupsV320Test-2057280708 None] Group tempest-GroupsV320Test-Group-407886607: created successfully Jul 15 18:40:19 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7ac35952-72a4-42d4-aa94-70575e251bb1 tempest-GroupsV320Test-2057280708 None] Create group completed successfully. Jul 15 18:40:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-5c72deb4-6c21-4135-8d3c-6c3ffc764687 req-772b4c0a-3c1e-446e-b914-945d0f4c15f9 tempest-TestShelveInstance-642695930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:19 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6 1073741824" returned: 0 in 0.780s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:19 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6 Jul 15 18:40:19 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:20 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6" returned: 0 in 0.326s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-5c72deb4-6c21-4135-8d3c-6c3ffc764687 req-772b4c0a-3c1e-446e-b914-945d0f4c15f9 tempest-TestShelveInstance-642695930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.599s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9abc71f-6abf-46b1-8fa0-9352b5742229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4cbed7-b0aa-4e31-a857-7e7e4e15a27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a451130-6301-4db8-8225-68d4801e7d7c]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-5c72deb4-6c21-4135-8d3c-6c3ffc764687 req-772b4c0a-3c1e-446e-b914-945d0f4c15f9 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-9f59841f-59a0-4e37-9036-5dd7503c17e7 req-06ffc300-72a4-4f40-bac5-c137450cdd04 tempest-TestStampPattern-596820549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:20 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Volume volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6 (2f64b965-cbb4-405f-81a4-a2dd64eabde6): created successfully Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4cbed7-b0aa-4e31-a857-7e7e4e15a27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Flow 'volume_create_manager' (ca3ecc32-0ff2-482a-9b9a-cee1d1310c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-fed44327-41b2-44b5-97fb-ee6b2a773823 tempest-VolumesTransfersV357Test-223315725 None] Created volume successfully. Jul 15 18:40:20 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:40:20 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:20 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-5c72deb4-6c21-4135-8d3c-6c3ffc764687 req-772b4c0a-3c1e-446e-b914-945d0f4c15f9 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 0 in 0.410s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-5c72deb4-6c21-4135-8d3c-6c3ffc764687 req-772b4c0a-3c1e-446e-b914-945d0f4c15f9 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:20 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:40:20 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:21 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-5c72deb4-6c21-4135-8d3c-6c3ffc764687 req-772b4c0a-3c1e-446e-b914-945d0f4c15f9 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 1 in 0.419s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-5c72deb4-6c21-4135-8d3c-6c3ffc764687 req-772b4c0a-3c1e-446e-b914-945d0f4c15f9 tempest-TestShelveInstance-642695930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:40:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-5c72deb4-6c21-4135-8d3c-6c3ffc764687 req-772b4c0a-3c1e-446e-b914-945d0f4c15f9 tempest-TestShelveInstance-642695930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.905s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-9f59841f-59a0-4e37-9036-5dd7503c17e7 req-06ffc300-72a4-4f40-bac5-c137450cdd04 tempest-TestStampPattern-596820549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.816s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:21 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e782fb-077d-4c58-a29d-6640ee3b406c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-9f59841f-59a0-4e37-9036-5dd7503c17e7 req-06ffc300-72a4-4f40-bac5-c137450cdd04 tempest-TestStampPattern-596820549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-5c72deb4-6c21-4135-8d3c-6c3ffc764687 req-772b4c0a-3c1e-446e-b914-945d0f4c15f9 tempest-TestShelveInstance-642695930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-5f28ca00-0808-4189-975c-73474f4ef2a6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65dd5f5e-41bb-439f-b47e-f1e73e2cd141', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:40:21 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-5c72deb4-6c21-4135-8d3c-6c3ffc764687 req-772b4c0a-3c1e-446e-b914-945d0f4c15f9 tempest-TestShelveInstance-642695930 None] attachment_update completed successfully. Jul 15 18:40:21 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 Jul 15 18:40:21 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:21 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-9f59841f-59a0-4e37-9036-5dd7503c17e7 req-06ffc300-72a4-4f40-bac5-c137450cdd04 tempest-TestStampPattern-596820549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628" returned: 0 in 0.455s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-9f59841f-59a0-4e37-9036-5dd7503c17e7 req-06ffc300-72a4-4f40-bac5-c137450cdd04 tempest-TestStampPattern-596820549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.473s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-9f59841f-59a0-4e37-9036-5dd7503c17e7 req-06ffc300-72a4-4f40-bac5-c137450cdd04 tempest-TestStampPattern-596820549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccf88380-5f61-4eb2-bfc1-117c6df90e50', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:40:21 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-9f59841f-59a0-4e37-9036-5dd7503c17e7 req-06ffc300-72a4-4f40-bac5-c137450cdd04 tempest-TestStampPattern-596820549 None] attachment_update completed successfully. Jul 15 18:40:22 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-a669e8c3-da22-4ddb-81c2-6d0a6dae0b62 tempest-GroupsV320Test-2057280708 None] Created reservations ['190842fc-ef91-4862-9f77-82d6a0400622'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a669e8c3-da22-4ddb-81c2-6d0a6dae0b62 tempest-GroupsV320Test-2057280708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a669e8c3-da22-4ddb-81c2-6d0a6dae0b62 tempest-GroupsV320Test-2057280708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a669e8c3-da22-4ddb-81c2-6d0a6dae0b62 tempest-GroupsV320Test-2057280708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a669e8c3-da22-4ddb-81c2-6d0a6dae0b62 tempest-GroupsV320Test-2057280708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a669e8c3-da22-4ddb-81c2-6d0a6dae0b62 tempest-GroupsV320Test-2057280708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a669e8c3-da22-4ddb-81c2-6d0a6dae0b62 tempest-GroupsV320Test-2057280708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:22 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:40:22 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:22 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3f4429d9-8234-406e-9393-b54814982fed tempest-VolumesTransfersV357Test-82793806 None] Transfer volume completed successfully. Jul 15 18:40:23 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a669e8c3-da22-4ddb-81c2-6d0a6dae0b62 tempest-GroupsV320Test-2057280708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.610s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:23 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a669e8c3-da22-4ddb-81c2-6d0a6dae0b62 tempest-GroupsV320Test-2057280708 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:23 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a669e8c3-da22-4ddb-81c2-6d0a6dae0b62 tempest-GroupsV320Test-2057280708 None] Delete group completed successfully. Jul 15 18:40:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Acquiring lock "cinder-2f64b965-cbb4-405f-81a4-a2dd64eabde6-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Lock "cinder-2f64b965-cbb4-405f-81a4-a2dd64eabde6-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Acquiring lock "cinder-quobyte-2f64b965-cbb4-405f-81a4-a2dd64eabde6" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Lock "cinder-quobyte-2f64b965-cbb4-405f-81a4-a2dd64eabde6" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:24 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[12022d10-80d3-4263-86ca-a6bc205d2248]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:24 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6 Jul 15 18:40:24 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:24 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6" returned: 0 in 0.491s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:24 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6 Jul 15 18:40:24 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:25 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f64b965-cbb4-405f-81a4-a2dd64eabde6" returned: 0 in 0.381s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Lock "cinder-quobyte-2f64b965-cbb4-405f-81a4-a2dd64eabde6" released by "delete_volume" :: held 0.956s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:25 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=76,cinder:UPDATE=70,cinder:DELETE=6,cinder:INSERT=25 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:40:25 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Created reservations ['35352bcc-9a95-4cbb-a4eb-321fdee0df81', '681ba6b1-7adb-4935-a265-bbd5c396094c', 'c784bddb-dec7-4d5d-a7e7-c1fc969daf9a', 'ea6a463e-b63c-45ed-b0bc-1497ca3a0d55'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:25 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:40:25 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:26 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.643s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:26 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:26 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Deleted volume successfully. Jul 15 18:40:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-adddb5fc-b59b-4c4e-83b9-3b9643ade764 tempest-VolumesTransfersV357Test-1369532279 None] Lock "cinder-2f64b965-cbb4-405f-81a4-a2dd64eabde6-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:26 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-f70a6f59-934d-469d-bc0e-696c0bcf8b5f req-d604d918-067a-4269-ada1-02fb0ad4cab5 tempest-TestStampPattern-596820549 None] Terminate volume connection completed successfully. Jul 15 18:40:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-f70a6f59-934d-469d-bc0e-696c0bcf8b5f req-d604d918-067a-4269-ada1-02fb0ad4cab5 tempest-TestStampPattern-596820549 None] Deleting attachment ccf88380-5f61-4eb2-bfc1-117c6df90e50. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Flow 'volume_create_manager' (4888161c-163b-4569-b67c-63167c4e5f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7c3572-222c-40d3-a443-4a44bfbcac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7c3572-222c-40d3-a443-4a44bfbcac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-186330684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833c11cd-4470-48a7-8536-2e5d54c49af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebf572bf3b84fb793727252581d53fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:28Z,use_quota=True,user_id='6f03137eab9f4484b3107217a0867af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01123f30-83d8-4102-9148-44e926eaf8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01123f30-83d8-4102-9148-44e926eaf8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f887ad0-4ffd-4907-ab55-1f9cb6b2f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f887ad0-4ffd-4907-ab55-1f9cb6b2f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '833c11cd-4470-48a7-8536-2e5d54c49af3', 'volume_name': 'volume-833c11cd-4470-48a7-8536-2e5d54c49af3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f17da2d-2bbb-4999-9302-9747010f16ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f17da2d-2bbb-4999-9302-9747010f16ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e3bfc8-7124-44f5-bdcc-2270085488e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:27 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Volume 833c11cd-4470-48a7-8536-2e5d54c49af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-833c11cd-4470-48a7-8536-2e5d54c49af3', 'volume_size': 1} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-186330684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833c11cd-4470-48a7-8536-2e5d54c49af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebf572bf3b84fb793727252581d53fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:28Z,use_quota=True,user_id='6f03137eab9f4484b3107217a0867af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Creating volume 833c11cd-4470-48a7-8536-2e5d54c49af3 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:27 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:40:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:27 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3 1073741824 Jul 15 18:40:27 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:28 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3 1073741824" returned: 0 in 0.774s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:28 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3 Jul 15 18:40:28 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:29 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3" returned: 0 in 0.685s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e3bfc8-7124-44f5-bdcc-2270085488e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-833c11cd-4470-48a7-8536-2e5d54c49af3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8109d389-69a8-4dff-bd73-3d49059064bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:29 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Volume volume-833c11cd-4470-48a7-8536-2e5d54c49af3 (833c11cd-4470-48a7-8536-2e5d54c49af3): created successfully Jul 15 18:40:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8109d389-69a8-4dff-bd73-3d49059064bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Flow 'volume_create_manager' (4888161c-163b-4569-b67c-63167c4e5f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:29 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d2e63dbb-63cb-41f5-9bf4-889bdc434273 tempest-VolumesTransfersV357Test-223315725 None] Created volume successfully. Jul 15 18:40:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Acquiring lock "cinder-833c11cd-4470-48a7-8536-2e5d54c49af3-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Lock "cinder-833c11cd-4470-48a7-8536-2e5d54c49af3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Acquiring lock "cinder-quobyte-833c11cd-4470-48a7-8536-2e5d54c49af3" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Lock "cinder-quobyte-833c11cd-4470-48a7-8536-2e5d54c49af3" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:30 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[521cf3ac-cdd7-4715-9f69-814a4c2a0185]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:30 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3 Jul 15 18:40:30 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:31 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3" returned: 0 in 0.785s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:31 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3 Jul 15 18:40:31 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:32 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-833c11cd-4470-48a7-8536-2e5d54c49af3" returned: 0 in 0.574s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Lock "cinder-quobyte-833c11cd-4470-48a7-8536-2e5d54c49af3" released by "delete_volume" :: held 1.443s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Created reservations ['c51f25dd-3354-47a9-9ed6-ea34a4ed6fbf', '4429c519-95ec-4794-9cff-2f899ea66ad0', 'c8be93d4-1efe-4ace-a051-03a89a89d26e', '00010a0e-c3c4-4fa8-b228-87ff94ead928'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:32 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:40:32 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:32 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.519s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:32 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Deleted volume successfully. Jul 15 18:40:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d114e5ba-1646-4a51-9c4a-48fdc7d7164f tempest-VolumesTransfersV357Test-1369532279 None] Lock "cinder-833c11cd-4470-48a7-8536-2e5d54c49af3-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Acquiring lock "cinder-4237c1b8-2e6a-408f-990e-a2cc0bb12628-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Lock "cinder-4237c1b8-2e6a-408f-990e-a2cc0bb12628-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Acquiring lock "cinder-quobyte-4237c1b8-2e6a-408f-990e-a2cc0bb12628" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-4237c1b8-2e6a-408f-990e-a2cc0bb12628" acquired by "delete_volume" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3faad3-0530-46e8-87c9-4a14605acac7]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:35 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 Jul 15 18:40:35 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:35 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:40:35 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:35 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628" returned: 0 in 0.611s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:35 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628 Jul 15 18:40:35 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:35 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.537s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:40:35 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4237c1b8-2e6a-408f-990e-a2cc0bb12628" returned: 0 in 0.336s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-4237c1b8-2e6a-408f-990e-a2cc0bb12628" released by "delete_volume" :: held 1.012s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:35 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Created reservations ['bb534e8d-589d-4ab4-ab62-6069b8b8bebf', '8c17900e-b9e1-4caa-9f6d-45416fc801a9', '6faa9ff1-46a8-40c4-95fd-cbb7c3ddca2c', 'bec4b644-c8fb-41f3-a9e6-b8389c239ed0'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:36 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:40:36 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:36 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.475s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:36 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Deleted volume successfully. Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-762cfffa-5de2-4a1d-8c71-76f28b8f175f tempest-TestStampPattern-596820549 None] Lock "cinder-4237c1b8-2e6a-408f-990e-a2cc0bb12628-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Flow 'volume_create_manager' (a386d196-68f9-448a-b96a-e44399b5d772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850b91ed-74c6-49ad-b996-9b7f9fb62c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850b91ed-74c6-49ad-b996-9b7f9fb62c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1524827949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3e2e65d1afc4e08b2d6e180485efce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:37Z,use_quota=True,user_id='4c0f5895fe084da8986438d6bc823da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acae12e-ad0a-4a3d-bbaf-f98aad2eeeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acae12e-ad0a-4a3d-bbaf-f98aad2eeeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800e8eec-afd5-4a2a-88d1-ba940e96f3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800e8eec-afd5-4a2a-88d1-ba940e96f3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f', 'volume_name': 'volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8259f3e5-a708-432e-a5ab-a85cac22014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8259f3e5-a708-432e-a5ab-a85cac22014e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce91789-7e40-49f0-b5ba-e8bdc7a93fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:36 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f', 'volume_size': 1} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1524827949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3e2e65d1afc4e08b2d6e180485efce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:37Z,use_quota=True,user_id='4c0f5895fe084da8986438d6bc823da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Creating volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:36 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:40:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:36 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f 1073741824 Jul 15 18:40:36 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:37 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f 1073741824" returned: 0 in 0.775s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Acquiring lock "cinder-e4d8e02d-4624-4d1b-ad47-dfa4862d20a1-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Lock "cinder-e4d8e02d-4624-4d1b-ad47-dfa4862d20a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Acquiring lock "cinder-quobyte-fbc7b30a-c746-40de-92cf-f0508037edc4" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:37 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f Jul 15 18:40:37 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-fbc7b30a-c746-40de-92cf-f0508037edc4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Acquiring lock "cinder-quobyte-e4d8e02d-4624-4d1b-ad47-dfa4862d20a1" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-e4d8e02d-4624-4d1b-ad47-dfa4862d20a1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Deleting offline snapshot e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 of volume fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] snapshot_file for this snap is: volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17afdf4a-07c3-493e-ba56-b8f46d31b926]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:38 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 Jul 15 18:40:38 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:38 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" returned: 0 in 0.484s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce91789-7e40-49f0-b5ba-e8bdc7a93fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d56620f-3f17-49c5-a770-e4562907a689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:38 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Volume volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f (6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f): created successfully Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d56620f-3f17-49c5-a770-e4562907a689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Flow 'volume_create_manager' (a386d196-68f9-448a-b96a-e44399b5d772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-572c0c7f-0ce5-45c3-86d3-be841c623a47 tempest-SnapshotsActionsTest-546834882 None] Created volume successfully. Jul 15 18:40:38 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1" returned: 0 in 0.599s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbc7b30a-c746-40de-92cf-f0508037edc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc035caf-608e-43f3-a299-91f34bf97659]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:38 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 Jul 15 18:40:38 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:39 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4" returned: 0 in 0.640s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:39 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 Jul 15 18:40:39 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Creating offline snapshot f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 of volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34dd0a3-83c8-4c2c-8518-6321092280c5]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:39 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f Jul 15 18:40:39 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:39 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1" returned: 0 in 0.450s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:39 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1 Jul 15 18:40:39 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:39 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" returned: 0 in 0.503s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:39 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 1G Jul 15 18:40:39 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:39 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4.e4d8e02d-4624-4d1b-ad47-dfa4862d20a1" returned: 0 in 0.309s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-e4d8e02d-4624-4d1b-ad47-dfa4862d20a1" released by "_delete_snapshot" :: held 2.160s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-fbc7b30a-c746-40de-92cf-f0508037edc4" released by "delete_snapshot" :: held 2.199s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:39 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Created reservations ['dc0fa9ab-18ee-4259-8d08-075c49c21ea5', 'e2ca4aa3-4d66-46fc-bfb2-d58beaf8e6c1', '8df79046-460d-40c1-86b9-a079d9e6395d', '635d51b7-87da-4d60-acf9-c01930023ec1'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:40 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Delete snapshot completed successfully. Jul 15 18:40:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b7e88711-abe4-48d5-b083-a31e79a3839a tempest-TestStampPattern-596820549 None] Lock "cinder-e4d8e02d-4624-4d1b-ad47-dfa4862d20a1-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:40 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 1G" returned: 0 in 0.499s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:40 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:40:40 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:40 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.396s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:40 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 is being set with open permissions: ugo+rw Jul 15 18:40:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:40 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:40:40 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:40 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.280s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:40 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.info Jul 15 18:40:40 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:41 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.info" returned: 0 in 0.346s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:41 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.info is being set with open permissions: ugo+rw Jul 15 18:40:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:41 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.info Jul 15 18:40:41 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:41 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.info" returned: 0 in 0.346s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:41 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-49e484b2-f9cf-45ec-b867-4d9b31f6830a tempest-SnapshotsActionsTest-546834882 None] Create snapshot completed successfully Jul 15 18:40:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] Creating offline snapshot 6dd04cec-96f1-40db-b2db-f343372bc919 of volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:40:43 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1380d4bc-4e7b-4a5a-8d93-6307708951af]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:43 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:40:43 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:44 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.497s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:44 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 1G Jul 15 18:40:44 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:44 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 1G" returned: 0 in 0.774s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:45 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 Jul 15 18:40:45 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:45 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919" returned: 0 in 0.409s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:45 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 is being set with open permissions: ugo+rw Jul 15 18:40:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:45 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 Jul 15 18:40:45 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:45 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919" returned: 0 in 0.335s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a073f433-d9f0-4b8a-9c30-17d39c748bd0 tempest-SnapshotsActionsTest-546834882 None] Create snapshot completed successfully Jul 15 18:40:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Acquiring lock "cinder-fbc7b30a-c746-40de-92cf-f0508037edc4-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Lock "cinder-fbc7b30a-c746-40de-92cf-f0508037edc4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Acquiring lock "cinder-quobyte-fbc7b30a-c746-40de-92cf-f0508037edc4" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-fbc7b30a-c746-40de-92cf-f0508037edc4" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:46 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88372f5-21cf-4570-a634-f3c4562e236f]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:46 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 Jul 15 18:40:46 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:46 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4" returned: 0 in 0.440s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:46 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4 Jul 15 18:40:46 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-6dd04cec-96f1-40db-b2db-f343372bc919-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:46 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-fbc7b30a-c746-40de-92cf-f0508037edc4" returned: 0 in 0.317s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Lock "cinder-quobyte-fbc7b30a-c746-40de-92cf-f0508037edc4" released by "delete_volume" :: held 0.837s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-6dd04cec-96f1-40db-b2db-f343372bc919-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-quobyte-6dd04cec-96f1-40db-b2db-f343372bc919" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-6dd04cec-96f1-40db-b2db-f343372bc919" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Deleting offline snapshot 6dd04cec-96f1-40db-b2db-f343372bc919 of volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] snapshot_file for this snap is: volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a3cf97-50d1-4dfd-9fd5-ef7174e998d6]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Created reservations ['787670cb-fdcf-4cf5-abea-ae22927f5a21', '9e0ef00b-fffd-42da-89f8-d1684b5ee38d', 'd402ea10-7b1c-4aab-b456-a13ce926e851', '45a3595a-2e7b-4327-ac10-5acb64928f28'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:47 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 Jul 15 18:40:47 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:47 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:40:47 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:47 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.341s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:47 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Deleted volume successfully. Jul 15 18:40:47 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919" returned: 0 in 0.584s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-752e8e40-6b67-4c60-aa6c-274956f0321b tempest-TestStampPattern-596820549 None] Lock "cinder-fbc7b30a-c746-40de-92cf-f0508037edc4-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b97cfa1-c970-4801-a280-93fefd2f957b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:47 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:40:47 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:48 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.385s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:48 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 Jul 15 18:40:48 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:48 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919" returned: 0 in 0.467s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:48 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919 Jul 15 18:40:48 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:48 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.6dd04cec-96f1-40db-b2db-f343372bc919" returned: 0 in 0.315s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-6dd04cec-96f1-40db-b2db-f343372bc919" released by "_delete_snapshot" :: held 1.907s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" released by "delete_snapshot" :: held 1.943s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:49 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Created reservations ['b7885818-dcc6-45f5-909d-29321dd8b640', 'd03b7479-af8c-440e-bd63-08283ff73056', 'f58a624c-d391-415f-9ee4-eea0cdc4cf2f', '8918fcc2-f80b-4b28-97a0-f175ec876a32'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:49 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Delete snapshot completed successfully. Jul 15 18:40:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e1b8af23-17d3-4e3f-9701-e0bdafac7f56 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-6dd04cec-96f1-40db-b2db-f343372bc919-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] Creating offline snapshot 07a0c85b-0632-4e2e-9a8f-0e20d4febdeb of volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:40:50 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2120b98-92cc-4dd7-9fc6-b1fa52a06b86]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:50 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:40:50 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:51 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.485s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:51 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb 1G Jul 15 18:40:51 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:51 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb 1G" returned: 0 in 0.779s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:52 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb Jul 15 18:40:52 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:52 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb" returned: 0 in 0.529s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:52 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb is being set with open permissions: ugo+rw Jul 15 18:40:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:52 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb Jul 15 18:40:52 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:52 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb" returned: 0 in 0.378s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:53 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6b9d336b-642a-417a-90a6-f41dba581e9a tempest-SnapshotsActionsTest-546834882 None] Create snapshot completed successfully Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-07a0c85b-0632-4e2e-9a8f-0e20d4febdeb-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-07a0c85b-0632-4e2e-9a8f-0e20d4febdeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-quobyte-07a0c85b-0632-4e2e-9a8f-0e20d4febdeb" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-07a0c85b-0632-4e2e-9a8f-0e20d4febdeb" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Deleting offline snapshot 07a0c85b-0632-4e2e-9a8f-0e20d4febdeb of volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] snapshot_file for this snap is: volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[064236f8-8970-4a7c-9794-4d3b591a62b3]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:54 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb Jul 15 18:40:54 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:54 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb" returned: 0 in 0.494s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76a4ce6-fbb0-4f42-875b-e56a9e402894]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:55 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:40:55 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:55 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.844s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:55 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb Jul 15 18:40:55 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:56 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb" returned: 0 in 0.588s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:56 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb Jul 15 18:40:56 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:56 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.07a0c85b-0632-4e2e-9a8f-0e20d4febdeb" returned: 0 in 0.383s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-07a0c85b-0632-4e2e-9a8f-0e20d4febdeb" released by "_delete_snapshot" :: held 2.501s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" released by "delete_snapshot" :: held 2.545s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:56 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Created reservations ['5667b51f-6672-4fc1-8b03-22d17e213332', '40909146-1af3-48b3-afd8-ff7f80ac85a6', '8b257463-73ce-405e-a998-00e66f2abc8b', 'd5bb4fd2-d013-4c5d-8f00-ea1f35796c9d'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:56 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Delete snapshot completed successfully. Jul 15 18:40:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-bca0622f-8ff3-4a88-8fe9-5da63a832917 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-07a0c85b-0632-4e2e-9a8f-0e20d4febdeb-delete_snapshot" released by "delete_snapshot" :: held 2.760s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] Creating offline snapshot 602c1972-b024-44be-bcfb-086983fba536 of volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:40:58 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13f1370-f520-4911-b011-5ad1d93bfcd4]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:58 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:40:58 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:58 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.555s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:58 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 1G Jul 15 18:40:58 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:59 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 1G" returned: 0 in 0.732s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:59 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 Jul 15 18:40:59 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:59 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536" returned: 0 in 0.444s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:59 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 is being set with open permissions: ugo+rw Jul 15 18:40:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:59 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 Jul 15 18:40:59 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:00 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536" returned: 0 in 0.332s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-69b28384-f909-4918-b6a7-58c853283672 tempest-SnapshotsActionsTest-546834882 None] Create snapshot completed successfully Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Flow 'volume_create_manager' (da582862-a057-42d7-9445-2e3682ba38b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226593d5-7628-4f08-9d0c-11f17f745a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226593d5-7628-4f08-9d0c-11f17f745a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-630234524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aad91d2-4cf5-4b13-b48b-de261e572189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc8b8b93cff4593b3cb5eb42317e3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:01Z,use_quota=True,user_id='76a43c8f2d3642239fce0d6299926880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4550d6-d40b-433c-8e09-0ed5e5c0bbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4550d6-d40b-433c-8e09-0ed5e5c0bbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57809ec1-6f53-4c76-a622-c189dbbac701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57809ec1-6f53-4c76-a622-c189dbbac701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aad91d2-4cf5-4b13-b48b-de261e572189', 'volume_name': 'volume-9aad91d2-4cf5-4b13-b48b-de261e572189', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cb5f75-6ce9-41e7-a750-d51e9d09d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cb5f75-6ce9-41e7-a750-d51e9d09d079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b86087-b272-45a1-880a-68d014ac139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:00 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Volume 9aad91d2-4cf5-4b13-b48b-de261e572189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aad91d2-4cf5-4b13-b48b-de261e572189', 'volume_size': 1} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-630234524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aad91d2-4cf5-4b13-b48b-de261e572189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc8b8b93cff4593b3cb5eb42317e3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:01Z,use_quota=True,user_id='76a43c8f2d3642239fce0d6299926880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Creating volume 9aad91d2-4cf5-4b13-b48b-de261e572189 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:41:00 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:41:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:00 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 1073741824 Jul 15 18:41:00 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-602c1972-b024-44be-bcfb-086983fba536-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-602c1972-b024-44be-bcfb-086983fba536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:01 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 1073741824" returned: 0 in 0.853s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-quobyte-602c1972-b024-44be-bcfb-086983fba536" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-602c1972-b024-44be-bcfb-086983fba536" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Deleting offline snapshot 602c1972-b024-44be-bcfb-086983fba536 of volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] snapshot_file for this snap is: volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a626bae2-a004-4fe5-abb6-becf264bc4a8]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:01 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 Jul 15 18:41:01 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:01 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-5ef5d209-9c5a-488c-8c82-94dbed8df04a req-d151c2b8-6652-41e8-9c3a-5d7ec2414160 tempest-TestShelveInstance-642695930 None] Terminate volume connection completed successfully. Jul 15 18:41:01 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-5ef5d209-9c5a-488c-8c82-94dbed8df04a req-d151c2b8-6652-41e8-9c3a-5d7ec2414160 tempest-TestShelveInstance-642695930 None] Deleting attachment 65dd5f5e-41bb-439f-b47e-f1e73e2cd141. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:41:02 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 Jul 15 18:41:02 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:02 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189" returned: 0 in 0.412s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b86087-b272-45a1-880a-68d014ac139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aad91d2-4cf5-4b13-b48b-de261e572189', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4917e13-9880-4a07-8d77-05927baad3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:02 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Volume volume-9aad91d2-4cf5-4b13-b48b-de261e572189 (9aad91d2-4cf5-4b13-b48b-de261e572189): created successfully Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4917e13-9880-4a07-8d77-05927baad3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Flow 'volume_create_manager' (da582862-a057-42d7-9445-2e3682ba38b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:02 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3ec3c2e1-cf93-4964-8f88-3bdf4c014037 tempest-VolumesActionsTest-1167112951 None] Created volume successfully. Jul 15 18:41:02 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536" returned: 0 in 0.593s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1dc524-52ab-4561-b59f-3a15eee3627a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:02 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:41:02 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:02 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.428s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:41:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:02 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 Jul 15 18:41:02 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:03 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536" returned: 0 in 0.474s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:03 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536 Jul 15 18:41:03 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:03 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.602c1972-b024-44be-bcfb-086983fba536" returned: 0 in 0.335s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-602c1972-b024-44be-bcfb-086983fba536" released by "_delete_snapshot" :: held 2.007s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" released by "delete_snapshot" :: held 2.060s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:03 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Created reservations ['a15d6d05-1da5-40ec-9ec4-48e7aeb6cb42', 'd36dd9d9-eef3-43c8-a4d0-ef9bf8286422', '119099d2-3a35-4988-b14b-23d3397dee42', 'aa1b8c1a-169b-47fe-8dcb-4681241cce82'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:03 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Delete snapshot completed successfully. Jul 15 18:41:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-603c17d6-9257-4bbf-9bfc-ea2ceeaaa4fb tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-602c1972-b024-44be-bcfb-086983fba536-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] Creating offline snapshot 99693051-8bd1-416b-8bbe-8871c7126747 of volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:41:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea36868-cbe1-4c74-90de-8e1c0860dc9e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:05 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:41:05 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-d44b2b41-83e6-40d5-93bf-6e55e9625937 req-e0711942-61df-45f4-835f-649b5f8a848f tempest-TestShelveInstance-642695930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:06 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.660s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:41:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:06 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 1G Jul 15 18:41:06 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:06 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 1G" returned: 0 in 0.663s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:06 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 Jul 15 18:41:06 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:07 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747" returned: 0 in 0.463s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:07 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 is being set with open permissions: ugo+rw Jul 15 18:41:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:07 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 Jul 15 18:41:07 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:07 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747" returned: 0 in 0.371s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-d44b2b41-83e6-40d5-93bf-6e55e9625937 req-e0711942-61df-45f4-835f-649b5f8a848f tempest-TestShelveInstance-642695930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.556s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:07 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=116,cinder:SELECT=118,cinder:INSERT=31,cinder:DELETE=6 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:41:07 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-69a6742d-f5bc-4c75-862c-3fac4320fb01 tempest-SnapshotsActionsTest-546834882 None] Create snapshot completed successfully Jul 15 18:41:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28135ac-fcb2-4654-86f6-641bdc3b2fd7]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-d44b2b41-83e6-40d5-93bf-6e55e9625937 req-e0711942-61df-45f4-835f-649b5f8a848f tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:07 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:41:07 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:08 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-d44b2b41-83e6-40d5-93bf-6e55e9625937 req-e0711942-61df-45f4-835f-649b5f8a848f tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 0 in 0.463s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-d44b2b41-83e6-40d5-93bf-6e55e9625937 req-e0711942-61df-45f4-835f-649b5f8a848f tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:08 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:41:08 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:08 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-d44b2b41-83e6-40d5-93bf-6e55e9625937 req-e0711942-61df-45f4-835f-649b5f8a848f tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 1 in 0.481s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-d44b2b41-83e6-40d5-93bf-6e55e9625937 req-e0711942-61df-45f4-835f-649b5f8a848f tempest-TestShelveInstance-642695930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:41:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-d44b2b41-83e6-40d5-93bf-6e55e9625937 req-e0711942-61df-45f4-835f-649b5f8a848f tempest-TestShelveInstance-642695930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-d44b2b41-83e6-40d5-93bf-6e55e9625937 req-e0711942-61df-45f4-835f-649b5f8a848f tempest-TestShelveInstance-642695930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-5f28ca00-0808-4189-975c-73474f4ef2a6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a96642f1-a89d-40bd-9a50-ae174106c96b', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:41:08 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-d44b2b41-83e6-40d5-93bf-6e55e9625937 req-e0711942-61df-45f4-835f-649b5f8a848f tempest-TestShelveInstance-642695930 None] attachment_update completed successfully. Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-99693051-8bd1-416b-8bbe-8871c7126747-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Flow 'volume_create_manager' (72cc8d53-b2c6-4017-a676-7941189977e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679aa586-e566-4043-bd42-77d0d8872f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-99693051-8bd1-416b-8bbe-8871c7126747-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679aa586-e566-4043-bd42-77d0d8872f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62435ad1-3bcc-4d79-879e-5788c67f4e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='370101b06f9741f89cb30e7dd259fdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:09Z,use_quota=True,user_id='cccb882d245643d19db8b6d83a3613d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e354d5b8-f94b-4763-963a-1fb02a8960a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e354d5b8-f94b-4763-963a-1fb02a8960a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce92c77-a347-4ee7-846e-c5a73cac7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.image.glance [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Creating Keystone auth plugin from conf {{(pid=87863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Acquiring lock "cinder-quobyte-99693051-8bd1-416b-8bbe-8871c7126747" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-99693051-8bd1-416b-8bbe-8871c7126747" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Deleting offline snapshot 99693051-8bd1-416b-8bbe-8871c7126747 of volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] snapshot_file for this snap is: volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3562ad67-3427-4605-9c8d-457c751b8c33]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:09 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 Jul 15 18:41:09 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce92c77-a347-4ee7-846e-c5a73cac7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '62435ad1-3bcc-4d79-879e-5788c67f4e7c', 'volume_name': 'volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c', 'volume_size': 1, 'image_id': 'cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1108fe1ded1f9daa716a7bbe9c0376ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '370101b06f9741f89cb30e7dd259fdfb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd10e2e5456755137b1eb916cc1158963bd8122d323be79e2c76908786d9285677502004f9b8c5f1c4cbf16bceeaa1312b197aea8d5ea47a75a793b00c4051b77', 'id': 'cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'created_at': datetime.datetime(2026, 7, 15, 16, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd50bcdc-db93-4cf2-9695-a7a2ca15d389/file', 'properties': {}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e63c19-753e-4547-8aac-61b99868e31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e63c19-753e-4547-8aac-61b99868e31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd6dfd0-a1d8-4880-94bb-5ec08da4faa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:09 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Volume 62435ad1-3bcc-4d79-879e-5788c67f4e7c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c', 'volume_size': 1, 'image_id': 'cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1108fe1ded1f9daa716a7bbe9c0376ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '370101b06f9741f89cb30e7dd259fdfb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd10e2e5456755137b1eb916cc1158963bd8122d323be79e2c76908786d9285677502004f9b8c5f1c4cbf16bceeaa1312b197aea8d5ea47a75a793b00c4051b77', 'id': 'cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'created_at': datetime.datetime(2026, 7, 15, 16, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd50bcdc-db93-4cf2-9695-a7a2ca15d389/file', 'properties': {}}, 'image_service': } Jul 15 18:41:09 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Trying to clone 62435ad1-3bcc-4d79-879e-5788c67f4e7c from image cd50bcdc-db93-4cf2-9695-a7a2ca15d389 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'metadata': {}}]). {{(pid=87863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:41:10 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747" returned: 0 in 0.790s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:41:10 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:41:10 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Image download 0.00 MB at 0.00 MB/s Jul 15 18:41:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[459c3b05-2861-44a5-a164-5d04b3d8a625]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ceb80d-f602-44bf-9cdb-54fecee89ff8]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:10 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:41:10 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:10 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD Jul 15 18:41:10 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:10 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:11 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.957s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:41:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:11 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD Jul 15 18:41:11 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:11 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 Jul 15 18:41:11 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:11 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD" returned: 1 in 0.763s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:41:11 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Temporary image cd50bcdc-db93-4cf2-9695-a7a2ca15d389 is fetched for user cccb882d245643d19db8b6d83a3613d7. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:41:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[871ebb20-601e-489a-b224-4a5f91216508]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:11 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747" returned: 0 in 0.798s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:11 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747 Jul 15 18:41:12 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:12 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD Jul 15 18:41:12 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:12 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.99693051-8bd1-416b-8bbe-8871c7126747" returned: 0 in 0.456s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-99693051-8bd1-416b-8bbe-8871c7126747" released by "_delete_snapshot" :: held 3.237s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" released by "delete_snapshot" :: held 3.279s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:12 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD" returned: 0 in 0.594s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:12 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Created reservations ['8abe02d4-3f69-42aa-8fdb-9df06023feaa', '25f45919-a3a8-40f2-9569-3c8c418bca43', '98f5695e-22ce-4c24-8315-597785ec934a', 'd0fa7af4-ec3d-476d-9569-bf774fcceeb2'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:12 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD Jul 15 18:41:12 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:12 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Delete snapshot completed successfully. Jul 15 18:41:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3102ffe9-f7d0-41f7-bd73-d596f93b8ee0 tempest-SnapshotsActionsTest-1494984431 None] Lock "cinder-99693051-8bd1-416b-8bbe-8871c7126747-delete_snapshot" released by "delete_snapshot" :: held 3.612s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-dea23327-8b3f-4ec9-ab9e-1a3990256ddd tempest-VolumesActionsTest-1167112951 None] Acquiring lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189" by "attach_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-dea23327-8b3f-4ec9-ab9e-1a3990256ddd tempest-VolumesActionsTest-1167112951 None] Lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189" acquired by "attach_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:13 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD" returned: 1 in 0.556s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62435ad1-3bcc-4d79-879e-5788c67f4e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='370101b06f9741f89cb30e7dd259fdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:09Z,use_quota=True,user_id='cccb882d245643d19db8b6d83a3613d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Creating volume 62435ad1-3bcc-4d79-879e-5788c67f4e7c {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:41:13 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:13 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c 1073741824 Jul 15 18:41:13 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:13 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-dea23327-8b3f-4ec9-ab9e-1a3990256ddd tempest-VolumesActionsTest-1167112951 None] Attaching volume 9aad91d2-4cf5-4b13-b48b-de261e572189 to instance 57b08227-cdfd-4dbc-b292-96ef3db73129 at mountpoint /dev/vdb on host None. Jul 15 18:41:13 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-dea23327-8b3f-4ec9-ab9e-1a3990256ddd tempest-VolumesActionsTest-1167112951 None] Attach volume completed successfully. Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-dea23327-8b3f-4ec9-ab9e-1a3990256ddd tempest-VolumesActionsTest-1167112951 None] Lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189" released by "attach_volume" :: held 0.190s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4c646d21-18b5-4960-8828-33b916057cd7 tempest-VolumesActionsTest-1167112951 None] Acquiring lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189-detach_volume" by "detach_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4c646d21-18b5-4960-8828-33b916057cd7 tempest-VolumesActionsTest-1167112951 None] Lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:13 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4c646d21-18b5-4960-8828-33b916057cd7 tempest-VolumesActionsTest-1167112951 None] Detaching volume 9aad91d2-4cf5-4b13-b48b-de261e572189 from instance 57b08227-cdfd-4dbc-b292-96ef3db73129. Jul 15 18:41:13 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4c646d21-18b5-4960-8828-33b916057cd7 tempest-VolumesActionsTest-1167112951 None] Detach volume completed successfully. Jul 15 18:41:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4c646d21-18b5-4960-8828-33b916057cd7 tempest-VolumesActionsTest-1167112951 None] Lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189-detach_volume" released by "detach_volume" :: held 0.201s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:14 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c 1073741824" returned: 0 in 0.928s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:14 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c Jul 15 18:41:14 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "cinder-f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Lock "cinder-f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "cinder-quobyte-f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Lock "cinder-quobyte-f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Deleting offline snapshot f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 of volume 6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] snapshot_file for this snap is: volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c1bfe-c799-4de7-8089-cdfa0a32065e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:14 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c" returned: 0 in 0.689s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:14 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:41:14 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:14 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Attempting download of cd50bcdc-db93-4cf2-9695-a7a2ca15d389 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'metadata': {}}])) to volume 62435ad1-3bcc-4d79-879e-5788c67f4e7c. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:41:15 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29adb4-a79a-4fc9-8d16-f268d7b1faed]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_co57nsuf {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:15 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_co57nsuf Jul 15 18:41:15 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:15 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 1.191s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:41:15 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc4c746-8546-4287-b373-f325fea4549c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:15 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_co57nsuf" returned: 0 in 0.861s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_co57nsuf {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:16 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f Jul 15 18:41:16 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:16 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_co57nsuf Jul 15 18:41:16 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:16 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" returned: 0 in 0.745s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:16 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:41:16 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:16 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_co57nsuf" returned: 1 in 0.745s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_co57nsuf' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:41:16 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5154e800-d4c4-4769-8309-5f767c30b0f9]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:16 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD Jul 15 18:41:16 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:17 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD" returned: 0 in 0.746s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:17 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.855s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:17 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5 Jul 15 18:41:17 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:17 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD Jul 15 18:41:17 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:17 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f.f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" returned: 0 in 0.395s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Lock "cinder-quobyte-f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5" released by "_delete_snapshot" :: held 3.502s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" released by "delete_snapshot" :: held 3.551s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:17 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD" returned: 1 in 0.557s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:41:18 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] cd50bcdc-db93-4cf2-9695-a7a2ca15d389 was raw, converting to raw {{(pid=87863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:41:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:18 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c Jul 15 18:41:18 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:18 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Created reservations ['fb31baa1-e576-4feb-9b10-f42a856ce4ab', '7d4e6800-544c-4782-a883-e594c410150f', 'd9490069-3c96-43ab-ac46-e3a443068b28', '64513de3-79a6-4fd0-b5c0-a7ea1c584f7b'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:18 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Delete snapshot completed successfully. Jul 15 18:41:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4a351454-b770-4055-b030-2c0eb3d5e3c6 tempest-SnapshotsActionsTest-546834882 None] Lock "cinder-f6a6113d-92cc-49a9-9e6b-cf9c9d23c9a5-delete_snapshot" released by "delete_snapshot" :: held 3.953s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:18 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c" returned: 0 in 0.589s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:18 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd50bcdc-db93-4cf2-9695-a7a2ca15d389_hh9lwyoudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:41:18 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Converted 0.00 MB image at 0.00 MB/s Jul 15 18:41:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:18 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c 1G Jul 15 18:41:18 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "cinder-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Lock "cinder-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" acquired by "delete_volume" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1243996-7982-4a6e-a800-afb9ad7756b5]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:19 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c 1G" returned: 0 in 0.623s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1bcc43-8aba-4874-8a46-b82a8ce50d40]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:19 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f Jul 15 18:41:19 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:19 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c Jul 15 18:41:19 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:19 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" returned: 0 in 0.694s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:19 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f Jul 15 18:41:19 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:19 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c" returned: 0 in 0.601s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:20 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c Jul 15 18:41:20 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:20 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" returned: 0 in 0.329s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Lock "cinder-quobyte-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f" released by "delete_volume" :: held 1.102s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Created reservations ['018e5444-e769-4230-8f55-8e021fda1a73', '10ced2b8-2321-430b-97c8-2c653d2a6106', '8dccfee3-d733-4c33-820b-81ebf8c83b89', 'ef4859c0-8a68-48e4-9660-b74e8d560648'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:20 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:41:20 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:20 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c" returned: 1 in 0.616s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Downloaded image cd50bcdc-db93-4cf2-9695-a7a2ca15d389 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'metadata': {}}])) to volume 62435ad1-3bcc-4d79-879e-5788c67f4e7c successfully. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Temporary image cd50bcdc-db93-4cf2-9695-a7a2ca15d389 for user cccb882d245643d19db8b6d83a3613d7 is deleted. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Marking volume 62435ad1-3bcc-4d79-879e-5788c67f4e7c as bootable. {{(pid=87863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Copying metadata from image cd50bcdc-db93-4cf2-9695-a7a2ca15d389 to 62435ad1-3bcc-4d79-879e-5788c67f4e7c. {{(pid=87863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Creating volume glance metadata for volume 62435ad1-3bcc-4d79-879e-5788c67f4e7c backed by image cd50bcdc-db93-4cf2-9695-a7a2ca15d389 with: {'image_id': 'cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1108fe1ded1f9daa716a7bbe9c0376ae', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd6dfd0-a1d8-4880-94bb-5ec08da4faa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c', 'volume_size': 1, 'image_id': 'cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1108fe1ded1f9daa716a7bbe9c0376ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '370101b06f9741f89cb30e7dd259fdfb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd10e2e5456755137b1eb916cc1158963bd8122d323be79e2c76908786d9285677502004f9b8c5f1c4cbf16bceeaa1312b197aea8d5ea47a75a793b00c4051b77', 'id': 'cd50bcdc-db93-4cf2-9695-a7a2ca15d389', 'created_at': datetime.datetime(2026, 7, 15, 16, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd50bcdc-db93-4cf2-9695-a7a2ca15d389/file', 'properties': {}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9946481f-b2ba-446c-a868-6d2d912c9555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:20 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Volume volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c (62435ad1-3bcc-4d79-879e-5788c67f4e7c): created successfully Jul 15 18:41:20 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9946481f-b2ba-446c-a868-6d2d912c9555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Flow 'volume_create_manager' (72cc8d53-b2c6-4017-a676-7941189977e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.341s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Deleted volume successfully. Jul 15 18:41:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-81fa0f61-cb9f-4bc5-b133-9f430bce8525 tempest-VolumeImageDependencyTests-1346310708 None] Created volume successfully. Jul 15 18:41:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5c29efa4-9de1-456c-8fa4-e9ddf00ee2b9 tempest-SnapshotsActionsTest-546834882 None] Lock "cinder-6b7a2d09-b9dd-4ef3-87cd-a4cef4c80a4f-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Acquiring lock "cinder-62435ad1-3bcc-4d79-879e-5788c67f4e7c-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Lock "cinder-62435ad1-3bcc-4d79-879e-5788c67f4e7c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Acquiring lock "cinder-quobyte-62435ad1-3bcc-4d79-879e-5788c67f4e7c" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Lock "cinder-quobyte-62435ad1-3bcc-4d79-879e-5788c67f4e7c" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:22 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a7710-7b76-42c7-8446-9c192f50b4ed]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:22 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c Jul 15 18:41:22 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:22 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c" returned: 0 in 0.687s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:22 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c Jul 15 18:41:22 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:23 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c" returned: 1 in 0.750s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:41:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:23 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c Jul 15 18:41:23 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:23 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62435ad1-3bcc-4d79-879e-5788c67f4e7c" returned: 0 in 0.362s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Lock "cinder-quobyte-62435ad1-3bcc-4d79-879e-5788c67f4e7c" released by "delete_volume" :: held 1.941s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:23 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Created reservations ['4bb01479-b2e1-45c0-8ddb-ad8519aafb5f', 'e823bf4d-9d16-42fa-9b2d-7f9fb045d658', '3a5e5c9f-ca96-4a45-80fb-0676a01164c7', '6a0037ff-0edb-4f68-a711-e232ca4a8266'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:24 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:41:24 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:24 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.337s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:24 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:24 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Deleted volume successfully. Jul 15 18:41:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2794abc2-19ff-4659-a04d-f96f67accc3d tempest-VolumeImageDependencyTests-1346310708 None] Lock "cinder-62435ad1-3bcc-4d79-879e-5788c67f4e7c-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e9b84596-67c7-44fb-83ea-0b2e49ca4724 tempest-VolumesActionsTest-1167112951 None] Acquiring lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189" by "attach_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e9b84596-67c7-44fb-83ea-0b2e49ca4724 tempest-VolumesActionsTest-1167112951 None] Lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189" acquired by "attach_volume" :: waited 0.034s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:32 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=93,cinder:INSERT=31,cinder:UPDATE=110,cinder:DELETE=9 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:41:32 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e9b84596-67c7-44fb-83ea-0b2e49ca4724 tempest-VolumesActionsTest-1167112951 None] Attaching volume 9aad91d2-4cf5-4b13-b48b-de261e572189 to instance 27dba973-1f9c-4afd-97cf-02e3e98948a6 at mountpoint /dev/vdb on host None. Jul 15 18:41:32 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e9b84596-67c7-44fb-83ea-0b2e49ca4724 tempest-VolumesActionsTest-1167112951 None] Attach volume completed successfully. Jul 15 18:41:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e9b84596-67c7-44fb-83ea-0b2e49ca4724 tempest-VolumesActionsTest-1167112951 None] Lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189" released by "attach_volume" :: held 0.180s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d4dbb3dd-5dc0-4d56-9f8c-779e7e3f60bd tempest-VolumesActionsTest-1167112951 None] Acquiring lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189-detach_volume" by "detach_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d4dbb3dd-5dc0-4d56-9f8c-779e7e3f60bd tempest-VolumesActionsTest-1167112951 None] Lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:32 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d4dbb3dd-5dc0-4d56-9f8c-779e7e3f60bd tempest-VolumesActionsTest-1167112951 None] Detaching volume 9aad91d2-4cf5-4b13-b48b-de261e572189 from instance 27dba973-1f9c-4afd-97cf-02e3e98948a6. Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Flow 'volume_create_manager' (a60b653a-6ec9-4701-817f-04aff9a21c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7daa46a-875c-4822-a6e7-f497e8dc17b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7daa46a-875c-4822-a6e7-f497e8dc17b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1239685238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e7d430-479c-4c70-9ebd-0d757e1f1c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e864d099795347108f58281fff693caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:33Z,use_quota=True,user_id='eae176422c5b45e5adb72074e7eaccf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747f98c9-2e7c-47b6-8693-7174f61fb4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747f98c9-2e7c-47b6-8693-7174f61fb4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c61781-9987-4eab-ac8f-5716d963a4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c61781-9987-4eab-ac8f-5716d963a4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93e7d430-479c-4c70-9ebd-0d757e1f1c85', 'volume_name': 'volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ccc5cf-5c3e-4f6b-a060-a5ffe65c2a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ccc5cf-5c3e-4f6b-a060-a5ffe65c2a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb3a693-29a3-4f27-aec6-fae9759c09ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:33 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Volume 93e7d430-479c-4c70-9ebd-0d757e1f1c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85', 'volume_size': 1} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1239685238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e7d430-479c-4c70-9ebd-0d757e1f1c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e864d099795347108f58281fff693caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:33Z,use_quota=True,user_id='eae176422c5b45e5adb72074e7eaccf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Creating volume 93e7d430-479c-4c70-9ebd-0d757e1f1c85 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:41:33 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:33 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85 1073741824 Jul 15 18:41:33 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d4dbb3dd-5dc0-4d56-9f8c-779e7e3f60bd tempest-VolumesActionsTest-1167112951 None] Detach volume completed successfully. Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d4dbb3dd-5dc0-4d56-9f8c-779e7e3f60bd tempest-VolumesActionsTest-1167112951 None] Lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189-detach_volume" released by "detach_volume" :: held 0.275s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:33 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85 1073741824" returned: 0 in 0.686s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:33 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85 Jul 15 18:41:33 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:34 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85" returned: 0 in 0.554s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:41:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb3a693-29a3-4f27-aec6-fae9759c09ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c961f3-bc49-405a-b528-59d4c0077d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:34 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Volume volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85 (93e7d430-479c-4c70-9ebd-0d757e1f1c85): created successfully Jul 15 18:41:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c961f3-bc49-405a-b528-59d4c0077d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Flow 'volume_create_manager' (a60b653a-6ec9-4701-817f-04aff9a21c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:34 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4294e742-7a41-4118-a98e-6fcdac3574a5 tempest-ProjectReaderTests-802550960 None] Created volume successfully. Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:35 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:41:35 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Acquiring lock "cinder-93e7d430-479c-4c70-9ebd-0d757e1f1c85-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Lock "cinder-93e7d430-479c-4c70-9ebd-0d757e1f1c85-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Acquiring lock "cinder-quobyte-93e7d430-479c-4c70-9ebd-0d757e1f1c85" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Lock "cinder-quobyte-93e7d430-479c-4c70-9ebd-0d757e1f1c85" acquired by "delete_volume" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:35 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.519s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91130cf-4d48-4bba-9694-65449f3b7215]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:35 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85 Jul 15 18:41:35 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:36 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85" returned: 0 in 0.458s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:36 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85 Jul 15 18:41:36 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:36 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-93e7d430-479c-4c70-9ebd-0d757e1f1c85" returned: 0 in 0.314s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Lock "cinder-quobyte-93e7d430-479c-4c70-9ebd-0d757e1f1c85" released by "delete_volume" :: held 0.854s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Created reservations ['9c758f9c-1c12-49b0-93ea-914c37b702e6', '1639b3b7-dae8-4f2b-a2fb-fe66ef8122e2', 'b02fe487-ca57-419e-a4d5-26a4a7f375a6', '9110cd61-b63c-44a9-8c82-dbc4442c4c82'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:36 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:41:36 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:37 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.418s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Deleted volume successfully. Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-afc957ee-2acb-4e21-a508-92ab7aa1a28e tempest-ProjectReaderTests-802550960 None] Lock "cinder-93e7d430-479c-4c70-9ebd-0d757e1f1c85-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Flow 'volume_create_manager' (09ea3f16-60cf-4b9b-87fd-765fc3354f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7c6c72-e74d-422a-81e1-1ebeaca77868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7c6c72-e74d-422a-81e1-1ebeaca77868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960801923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361eaa13-c229-4e6d-b42d-68c29baf3559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e864d099795347108f58281fff693caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:38Z,use_quota=True,user_id='eae176422c5b45e5adb72074e7eaccf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539714c0-2fd1-4ab1-a2b6-17eb91b462d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539714c0-2fd1-4ab1-a2b6-17eb91b462d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4837dab3-dcb5-4333-939b-5afb6c0558ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4837dab3-dcb5-4333-939b-5afb6c0558ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361eaa13-c229-4e6d-b42d-68c29baf3559', 'volume_name': 'volume-361eaa13-c229-4e6d-b42d-68c29baf3559', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9798539d-2c21-413c-8f20-3b21436752dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9798539d-2c21-413c-8f20-3b21436752dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ef937b-03fd-49d7-8b1c-bfbec24e56a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Volume 361eaa13-c229-4e6d-b42d-68c29baf3559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361eaa13-c229-4e6d-b42d-68c29baf3559', 'volume_size': 1} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960801923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361eaa13-c229-4e6d-b42d-68c29baf3559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e864d099795347108f58281fff693caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:38Z,use_quota=True,user_id='eae176422c5b45e5adb72074e7eaccf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Creating volume 361eaa13-c229-4e6d-b42d-68c29baf3559 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:41:37 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:41:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:37 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559 1073741824 Jul 15 18:41:37 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:38 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559 1073741824" returned: 0 in 0.591s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:38 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559 Jul 15 18:41:38 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:38 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559" returned: 0 in 0.376s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ef937b-03fd-49d7-8b1c-bfbec24e56a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361eaa13-c229-4e6d-b42d-68c29baf3559', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86e2bca-bec2-4d52-9380-8a7b69b61a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f652d7-50c6-4b8c-916c-5368337d08e4]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:38 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Volume volume-361eaa13-c229-4e6d-b42d-68c29baf3559 (361eaa13-c229-4e6d-b42d-68c29baf3559): created successfully Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86e2bca-bec2-4d52-9380-8a7b69b61a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Flow 'volume_create_manager' (09ea3f16-60cf-4b9b-87fd-765fc3354f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1446b684-8d8c-45d4-a2fa-d625dcab984f tempest-ProjectReaderTests-802550960 None] Created volume successfully. Jul 15 18:41:38 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 Jul 15 18:41:38 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:39 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189" returned: 0 in 0.396s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e2696-e5a0-464d-b940-6a2bb9a27c41]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:39 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 Jul 15 18:41:39 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:39 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189" returned: 0 in 0.431s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.13daa48b-40a1-464d-bc2f-985357cc512akqp92fol.img {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:39 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.13daa48b-40a1-464d-bc2f-985357cc512akqp92fol.img Jul 15 18:41:39 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Acquiring lock "cinder-361eaa13-c229-4e6d-b42d-68c29baf3559-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Lock "cinder-361eaa13-c229-4e6d-b42d-68c29baf3559-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Acquiring lock "cinder-quobyte-361eaa13-c229-4e6d-b42d-68c29baf3559" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Lock "cinder-quobyte-361eaa13-c229-4e6d-b42d-68c29baf3559" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[375a31b0-96e6-47f6-be8c-db5a72a24059]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:39 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559 Jul 15 18:41:40 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:40 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559" returned: 0 in 0.847s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:40 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559 Jul 15 18:41:40 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:41 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-361eaa13-c229-4e6d-b42d-68c29baf3559" returned: 0 in 0.635s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Lock "cinder-quobyte-361eaa13-c229-4e6d-b42d-68c29baf3559" released by "delete_volume" :: held 1.559s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:41 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Created reservations ['007ee8db-23d0-4cd9-a3a6-4134ef91bf1c', '437701d3-47b3-4793-87c2-d28d58fa04ae', '7028a771-b37f-4125-9f8c-1e5e98196e66', '128114e4-b538-436f-8f80-e95530056a5a'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:41 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:41:41 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:42 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.469s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:42 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:42 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Deleted volume successfully. Jul 15 18:41:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9dd8e5f9-d445-4e36-af58-3b8f909df771 tempest-ProjectReaderTests-802550960 None] Lock "cinder-361eaa13-c229-4e6d-b42d-68c29baf3559-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:45 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.13daa48b-40a1-464d-bc2f-985357cc512akqp92fol.img" returned: 0 in 5.826s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:45 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e84a3e-2dce-486e-851f-5ca4a4df1133]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:45 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 Jul 15 18:41:45 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:46 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189" returned: 0 in 0.827s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.13daa48b-40a1-464d-bc2f-985357cc512akqp92fol.img {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:41:46 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Converted 1024.00 MB image at 175.72 MB/s Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] 13daa48b-40a1-464d-bc2f-985357cc512a was raw, no need to convert to raw {{(pid=87863) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Flow 'volume_create_manager' (02c9eda4-2b4a-4c3e-b0f4-5b7e971e8795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d682f010-ff68-457e-b130-014708dbe49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d682f010-ff68-457e-b130-014708dbe49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-476312182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a56aae3-8cde-4fa9-b138-69a81130521c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509629bb0abf4fe28bae6728ce3a13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:46Z,use_quota=True,user_id='8b6cbe6d521b42fd8b0ca3290451d8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81a1a24-f011-4b68-a144-4ad170b5be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81a1a24-f011-4b68-a144-4ad170b5be1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83226d43-5179-4d4b-b8ad-0f1f29c2973e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83226d43-5179-4d4b-b8ad-0f1f29c2973e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a56aae3-8cde-4fa9-b138-69a81130521c', 'volume_name': 'volume-3a56aae3-8cde-4fa9-b138-69a81130521c', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abae9e4-3274-4bfc-b215-1c6c0b5ab2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abae9e4-3274-4bfc-b215-1c6c0b5ab2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272463e4-4235-4917-abe1-ba732e6a937c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:46 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Volume 3a56aae3-8cde-4fa9-b138-69a81130521c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a56aae3-8cde-4fa9-b138-69a81130521c', 'volume_size': 1} Jul 15 18:41:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:56 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=69,cinder:UPDATE=59,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:41:56 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=25,cinder:SELECT=18,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:41:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-bfdb394b-1e92-4093-82dd-7d19762b53e6 tempest-TestShelveInstance-642695930 None] Terminate volume connection completed successfully. Jul 15 18:41:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-bfdb394b-1e92-4093-82dd-7d19762b53e6 tempest-TestShelveInstance-642695930 None] Deleting attachment a96642f1-a89d-40bd-9a50-ae174106c96b. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:41:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Acquiring lock "cinder-5f28ca00-0808-4189-975c-73474f4ef2a6-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Lock "cinder-5f28ca00-0808-4189-975c-73474f4ef2a6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Acquiring lock "cinder-quobyte-5f28ca00-0808-4189-975c-73474f4ef2a6" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Lock "cinder-quobyte-5f28ca00-0808-4189-975c-73474f4ef2a6" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:59 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a953e6f0-0831-44d2-afc0-26cee0068630]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:59 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:41:59 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:00 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 0 in 0.547s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:00 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:42:00 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:00 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 1 in 0.453s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:00 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6 Jul 15 18:42:00 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:00 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f28ca00-0808-4189-975c-73474f4ef2a6" returned: 0 in 0.276s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Lock "cinder-quobyte-5f28ca00-0808-4189-975c-73474f4ef2a6" released by "delete_volume" :: held 1.385s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:01 devstack cinder-volume[87863]: DEBUG cinder.quota [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Created reservations ['599a4963-ae38-446e-9c4c-126aa3167700', '197be3bf-4df2-4602-bded-3d783d884923', '542af792-afd3-4b35-8a36-8c85ebd9c940', '8f7393ea-6f24-4498-90f1-03c29c239389'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:01 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:01 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:01 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.302s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:01 devstack cinder-volume[87863]: DEBUG cinder.manager [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:01 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Deleted volume successfully. Jul 15 18:42:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [req-3c19aa6b-808c-4153-b079-85ffd5595297 req-df9e563d-2960-4ecc-b37e-41a0f2007754 tempest-TestShelveInstance-642695930 None] Lock "cinder-5f28ca00-0808-4189-975c-73474f4ef2a6-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.702s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Uploaded volume to glance image-id: 13daa48b-40a1-464d-bc2f-985357cc512a. {{(pid=87863) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.842s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-476312182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a56aae3-8cde-4fa9-b138-69a81130521c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509629bb0abf4fe28bae6728ce3a13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:46Z,use_quota=True,user_id='8b6cbe6d521b42fd8b0ca3290451d8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Creating volume 3a56aae3-8cde-4fa9-b138-69a81130521c {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:08 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:08 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c 1073741824 Jul 15 18:42:08 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:08 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8d6c5bae-9347-4d9e-965a-8f31105b4f4a tempest-VolumesActionsTest-1167112951 None] Copy volume to image completed successfully. Jul 15 18:42:08 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c 1073741824" returned: 0 in 0.470s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:08 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c Jul 15 18:42:08 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:09 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c" returned: 0 in 0.283s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272463e4-4235-4917-abe1-ba732e6a937c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a56aae3-8cde-4fa9-b138-69a81130521c', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d014f30c-6196-4f98-bc2c-a6f6a8c14d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:09 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Volume volume-3a56aae3-8cde-4fa9-b138-69a81130521c (3a56aae3-8cde-4fa9-b138-69a81130521c): created successfully Jul 15 18:42:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d014f30c-6196-4f98-bc2c-a6f6a8c14d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Flow 'volume_create_manager' (02c9eda4-2b4a-4c3e-b0f4-5b7e971e8795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:09 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e900983b-0255-4185-bf08-4a03fb55f97a tempest-VolumeQuotasAdminTestJSON-606428462 None] Created volume successfully. Jul 15 18:42:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Acquiring lock "cinder-3a56aae3-8cde-4fa9-b138-69a81130521c-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "cinder-3a56aae3-8cde-4fa9-b138-69a81130521c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Acquiring lock "cinder-quobyte-3a56aae3-8cde-4fa9-b138-69a81130521c" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "cinder-quobyte-3a56aae3-8cde-4fa9-b138-69a81130521c" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca9a4f7-4d69-47f0-ac35-18beef4abca9]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:10 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c Jul 15 18:42:10 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6337552-9229-4015-971a-c260807c9439]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:10 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 Jul 15 18:42:10 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:11 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c" returned: 0 in 0.469s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:11 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c Jul 15 18:42:11 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:11 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189" returned: 0 in 0.452s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca55f16-1738-446d-bb34-d2c4c7d27cff]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:11 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 Jul 15 18:42:11 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:11 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3a56aae3-8cde-4fa9-b138-69a81130521c" returned: 0 in 0.326s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "cinder-quobyte-3a56aae3-8cde-4fa9-b138-69a81130521c" released by "delete_volume" :: held 0.860s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Created reservations ['77f11f69-9143-4cf5-bc62-52c3e35eedc1', 'd16540a2-898a-47c5-961b-6498caf7d678', 'c749b4c9-e7ef-4b19-9a5d-40e895c82eb7', '844b5299-7a3d-49b3-9ce5-0d9192268646'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:11 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:11 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:11 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189" returned: 0 in 0.454s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:11 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img Jul 15 18:42:11 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:11 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.360s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:11 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Deleted volume successfully. Jul 15 18:42:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ae3ccd9-3360-4089-89dd-a140fe6ba74b tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "cinder-3a56aae3-8cde-4fa9-b138-69a81130521c-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:12 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Flow 'volume_create_manager' (2d0d6125-be29-4c85-988b-aaa1a5dfb0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f988169-4dc5-4749-a52e-0e911e083bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f988169-4dc5-4749-a52e-0e911e083bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2104660036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484027a0-18a0-4d64-a4e0-9f92c358706a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509629bb0abf4fe28bae6728ce3a13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:13Z,use_quota=True,user_id='8b6cbe6d521b42fd8b0ca3290451d8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2d7cdc-d25b-493c-9c22-69d2fb0a93fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2d7cdc-d25b-493c-9c22-69d2fb0a93fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e230de-065c-4bd8-86e3-40b6e001993e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e230de-065c-4bd8-86e3-40b6e001993e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '484027a0-18a0-4d64-a4e0-9f92c358706a', 'volume_name': 'volume-484027a0-18a0-4d64-a4e0-9f92c358706a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd681ca8-395e-4657-b628-63a09f897a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd681ca8-395e-4657-b628-63a09f897a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645795a7-9cde-4fe1-9a5b-583d4af0a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:13 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Volume 484027a0-18a0-4d64-a4e0-9f92c358706a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-484027a0-18a0-4d64-a4e0-9f92c358706a', 'volume_size': 1} Jul 15 18:42:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:16 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img" returned: 0 in 4.921s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:16 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfccdd1b-6ea2-4d85-94f4-560d11d1c827]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:16 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 Jul 15 18:42:16 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:17 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189" returned: 0 in 0.552s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:17 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:42:17 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Converted 1024.00 MB image at 208.03 MB/s Jul 15 18:42:17 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] 96591203-bd2f-412d-ada1-c7c9ad97239e was raw, converting to qcow2 {{(pid=87863) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 15 18:42:17 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c0102e-4944-47b5-a1bd-017712aaa38d]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:17 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img Jul 15 18:42:17 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:17 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img" returned: 0 in 0.338s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:17 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img Jul 15 18:42:17 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:17 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img" returned: 1 in 0.329s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img /opt/stack/data/cinder/conversion/vol_upload_ou6u9fsu {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:17 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img /opt/stack/data/cinder/conversion/vol_upload_ou6u9fsu Jul 15 18:42:17 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:18 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img /opt/stack/data/cinder/conversion/vol_upload_ou6u9fsu" returned: 0 in 0.271s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:18 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Image conversion details: src /opt/stack/data/cinder/conversion/9aad91d2-4cf5-4b13-b48b-de261e572189.temp_image.96591203-bd2f-412d-ada1-c7c9ad97239eooxcyhez.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ou6u9fsu {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:42:18 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 15 18:42:18 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb1c5f5-a7b3-4d3d-a40b-d270264845af]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ou6u9fsu {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:18 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ou6u9fsu Jul 15 18:42:18 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:18 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ou6u9fsu" returned: 0 in 0.343s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.243s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Uploaded volume to glance image-id: 96591203-bd2f-412d-ada1-c7c9ad97239e. {{(pid=87863) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.889s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2104660036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484027a0-18a0-4d64-a4e0-9f92c358706a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509629bb0abf4fe28bae6728ce3a13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:13Z,use_quota=True,user_id='8b6cbe6d521b42fd8b0ca3290451d8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Creating volume 484027a0-18a0-4d64-a4e0-9f92c358706a {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:19 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:19 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a 1073741824 Jul 15 18:42:19 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bcae5ead-6077-4eb7-9729-5dc11ebf2cd0 tempest-VolumesActionsTest-1167112951 None] Copy volume to image completed successfully. Jul 15 18:42:20 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a 1073741824" returned: 0 in 0.515s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:20 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a Jul 15 18:42:20 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:20 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645795a7-9cde-4fe1-9a5b-583d4af0a586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484027a0-18a0-4d64-a4e0-9f92c358706a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cc51d7-1a42-49b6-9f79-567b8848d5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:20 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Volume volume-484027a0-18a0-4d64-a4e0-9f92c358706a (484027a0-18a0-4d64-a4e0-9f92c358706a): created successfully Jul 15 18:42:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cc51d7-1a42-49b6-9f79-567b8848d5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Flow 'volume_create_manager' (2d0d6125-be29-4c85-988b-aaa1a5dfb0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-40d702be-0161-456d-bb7c-f4a53c1964ec tempest-VolumeQuotasAdminTestJSON-606428462 None] Created volume successfully. Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Flow 'volume_create_manager' (4c0c954b-8ad2-46c9-b4c0-fece30f9c138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df43f545-457d-47b4-9753-914677b1844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df43f545-457d-47b4-9753-914677b1844a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798d4101-11a1-48bd-95fe-1a332c5fbb64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae7ecbe300d4cb48c5d69457517b889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:21Z,use_quota=True,user_id='839b43a4deb644ffab83ce47f47c25a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6175d25a-722b-4288-9a3a-bec146136305),volume_type_id=6175d25a-722b-4288-9a3a-bec146136305)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d166f7aa-012b-43c0-9e65-d6029b371ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d166f7aa-012b-43c0-9e65-d6029b371ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed46e7e-0626-45e3-ada2-e5a18442b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.image.glance [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Creating Keystone auth plugin from conf {{(pid=87863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed46e7e-0626-45e3-ada2-e5a18442b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '798d4101-11a1-48bd-95fe-1a332c5fbb64', 'volume_name': 'volume-798d4101-11a1-48bd-95fe-1a332c5fbb64', 'volume_size': 1, 'image_id': '61faafaf-335e-4d25-acb1-8f7f5e964dff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61faafaf-335e-4d25-acb1-8f7f5e964dff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ac1730d2588bed487002e93a1b252ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bae7ecbe300d4cb48c5d69457517b889', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd4310a459e2f5ca8b1c821425661e270d4f0a9546072a27f2a5a1ff98d4133bea97de94a931d2840fb284b620772cb376e2007fd33f8dba4241f0f78d2faa13', 'id': '61faafaf-335e-4d25-acb1-8f7f5e964dff', 'created_at': datetime.datetime(2026, 7, 15, 16, 42, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 42, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61faafaf-335e-4d25-acb1-8f7f5e964dff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efcb35c-c5a2-4071-9190-216861cc3728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efcb35c-c5a2-4071-9190-216861cc3728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d595e3-e5b5-4b80-b346-c4a71d883832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Volume 798d4101-11a1-48bd-95fe-1a332c5fbb64: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-798d4101-11a1-48bd-95fe-1a332c5fbb64', 'volume_size': 1, 'image_id': '61faafaf-335e-4d25-acb1-8f7f5e964dff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61faafaf-335e-4d25-acb1-8f7f5e964dff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ac1730d2588bed487002e93a1b252ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bae7ecbe300d4cb48c5d69457517b889', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd4310a459e2f5ca8b1c821425661e270d4f0a9546072a27f2a5a1ff98d4133bea97de94a931d2840fb284b620772cb376e2007fd33f8dba4241f0f78d2faa13', 'id': '61faafaf-335e-4d25-acb1-8f7f5e964dff', 'created_at': datetime.datetime(2026, 7, 15, 16, 42, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 42, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61faafaf-335e-4d25-acb1-8f7f5e964dff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Trying to clone 798d4101-11a1-48bd-95fe-1a332c5fbb64 from image 61faafaf-335e-4d25-acb1-8f7f5e964dff at location (None, [{'url': 'file:///opt/stack/data/glance/images/61faafaf-335e-4d25-acb1-8f7f5e964dff', 'metadata': {}}]). {{(pid=87863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:42:21 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Image download 0.00 MB at 0.00 MB/s Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0afd38d-f9cb-4523-b53a-f6122d8e53d3]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:21 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD Jul 15 18:42:21 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Acquiring lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Acquiring lock "cinder-quobyte-9aad91d2-4cf5-4b13-b48b-de261e572189" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Lock "cinder-quobyte-9aad91d2-4cf5-4b13-b48b-de261e572189" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7b8c22-ef74-4f29-9828-4d20dd12a899]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:21 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:22 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 Jul 15 18:42:22 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:22 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD Jul 15 18:42:22 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:22 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189" returned: 0 in 0.485s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:22 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Temporary image 61faafaf-335e-4d25-acb1-8f7f5e964dff is fetched for user 839b43a4deb644ffab83ce47f47c25a8. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:42:22 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5abd5952-bd4c-42bc-a29c-5a8363cd057b tempest-VolumeQuotasAdminTestJSON-1892288712 None] Transfer volume completed successfully. Jul 15 18:42:22 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189 Jul 15 18:42:22 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7ddf48-45e5-4d75-b468-7715fa04d6a7]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:22 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD Jul 15 18:42:22 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:22 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9aad91d2-4cf5-4b13-b48b-de261e572189" returned: 0 in 0.311s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Lock "cinder-quobyte-9aad91d2-4cf5-4b13-b48b-de261e572189" released by "delete_volume" :: held 0.847s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Created reservations ['940e7458-e8e0-40c2-b578-82e2d4bea66d', 'ba656a50-3b8d-454e-a74e-2add87fc8f56', '9a3a77ef-fdb2-458e-af40-8d9507ead829', '2fe5fba1-3a5c-4cd4-b33b-150faed2a0a5'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:22 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:22 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:22 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:22 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD Jul 15 18:42:22 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Acquiring lock "cinder-484027a0-18a0-4d64-a4e0-9f92c358706a-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Lock "cinder-484027a0-18a0-4d64-a4e0-9f92c358706a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:23 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Acquiring lock "cinder-quobyte-484027a0-18a0-4d64-a4e0-9f92c358706a" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.359s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:23 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Deleted volume successfully. Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Lock "cinder-quobyte-484027a0-18a0-4d64-a4e0-9f92c358706a" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f50eccb-6e62-492b-afe8-69e18495b4ad tempest-VolumesActionsTest-1167112951 None] Lock "cinder-9aad91d2-4cf5-4b13-b48b-de261e572189-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de246a8-6479-480c-9047-0a9a22dba1ec]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:23 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798d4101-11a1-48bd-95fe-1a332c5fbb64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae7ecbe300d4cb48c5d69457517b889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:21Z,use_quota=True,user_id='839b43a4deb644ffab83ce47f47c25a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6175d25a-722b-4288-9a3a-bec146136305),volume_type_id=6175d25a-722b-4288-9a3a-bec146136305)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Creating volume 798d4101-11a1-48bd-95fe-1a332c5fbb64 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:23 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:23 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 1073741824 Jul 15 18:42:23 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:23 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a Jul 15 18:42:23 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:23 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a" returned: 0 in 0.413s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:23 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a Jul 15 18:42:23 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:23 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 1073741824" returned: 0 in 0.589s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:23 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 Jul 15 18:42:23 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:24 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-484027a0-18a0-4d64-a4e0-9f92c358706a" returned: 0 in 0.369s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Lock "cinder-quobyte-484027a0-18a0-4d64-a4e0-9f92c358706a" released by "delete_volume" :: held 0.835s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Created reservations ['e5db15b0-d04d-4778-86ef-270e06650135', 'a3d185a1-7a45-47be-8996-8b4fc993a311', '93870f1a-96f1-4543-8302-7a387d5c896c', 'e1cb7c57-0dc8-45e5-8d46-38d8ac397ea8'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:24 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:24 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:24 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64" returned: 0 in 0.322s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Attempting download of 61faafaf-335e-4d25-acb1-8f7f5e964dff ((None, [{'url': 'file:///opt/stack/data/glance/images/61faafaf-335e-4d25-acb1-8f7f5e964dff', 'metadata': {}}])) to volume 798d4101-11a1-48bd-95fe-1a332c5fbb64. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35844f2a-566c-4cc5-9308-b939664937c4]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61faafaf-335e-4d25-acb1-8f7f5e964dff_z_o5pcru {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:24 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.275s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:24 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Deleted volume successfully. Jul 15 18:42:24 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61faafaf-335e-4d25-acb1-8f7f5e964dff_z_o5pcru Jul 15 18:42:24 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9c349d8e-554d-46b9-9c00-72dde2e62e07 tempest-VolumeQuotasAdminTestJSON-880012113 None] Lock "cinder-484027a0-18a0-4d64-a4e0-9f92c358706a-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:24 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61faafaf-335e-4d25-acb1-8f7f5e964dff_z_o5pcru" returned: 0 in 0.354s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61faafaf-335e-4d25-acb1-8f7f5e964dff_z_o5pcru {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:24 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61faafaf-335e-4d25-acb1-8f7f5e964dff_z_o5pcru Jul 15 18:42:24 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:25 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61faafaf-335e-4d25-acb1-8f7f5e964dff_z_o5pcru" returned: 1 in 0.360s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61faafaf-335e-4d25-acb1-8f7f5e964dff_z_o5pcru' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:25 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ab8054-670e-4153-a97d-622f4d9152ad]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:25 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD Jul 15 18:42:25 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:25 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:25 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD Jul 15 18:42:25 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:25 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD" returned: 1 in 0.411s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:25 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] 61faafaf-335e-4d25-acb1-8f7f5e964dff was raw, converting to raw {{(pid=87863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:42:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:25 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 Jul 15 18:42:25 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:26 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64" returned: 0 in 0.491s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:26 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61faafaf-335e-4d25-acb1-8f7f5e964dff_yv34b1jqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:42:26 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Converted 0.00 MB image at 0.00 MB/s Jul 15 18:42:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:26 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 1G Jul 15 18:42:26 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:26 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 1G" returned: 0 in 0.343s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:26 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5678cf6-2b8c-4253-88a1-28b5432c4117]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:26 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 Jul 15 18:42:26 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:27 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64" returned: 0 in 0.433s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:27 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 Jul 15 18:42:27 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:27 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64" returned: 1 in 0.499s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Downloaded image 61faafaf-335e-4d25-acb1-8f7f5e964dff ((None, [{'url': 'file:///opt/stack/data/glance/images/61faafaf-335e-4d25-acb1-8f7f5e964dff', 'metadata': {}}])) to volume 798d4101-11a1-48bd-95fe-1a332c5fbb64 successfully. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Temporary image 61faafaf-335e-4d25-acb1-8f7f5e964dff for user 839b43a4deb644ffab83ce47f47c25a8 is deleted. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Marking volume 798d4101-11a1-48bd-95fe-1a332c5fbb64 as bootable. {{(pid=87863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Copying metadata from image 61faafaf-335e-4d25-acb1-8f7f5e964dff to 798d4101-11a1-48bd-95fe-1a332c5fbb64. {{(pid=87863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Creating volume glance metadata for volume 798d4101-11a1-48bd-95fe-1a332c5fbb64 backed by image 61faafaf-335e-4d25-acb1-8f7f5e964dff with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '61faafaf-335e-4d25-acb1-8f7f5e964dff', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6ac1730d2588bed487002e93a1b252ad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d595e3-e5b5-4b80-b346-c4a71d883832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798d4101-11a1-48bd-95fe-1a332c5fbb64', 'volume_size': 1, 'image_id': '61faafaf-335e-4d25-acb1-8f7f5e964dff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61faafaf-335e-4d25-acb1-8f7f5e964dff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ac1730d2588bed487002e93a1b252ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bae7ecbe300d4cb48c5d69457517b889', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd4310a459e2f5ca8b1c821425661e270d4f0a9546072a27f2a5a1ff98d4133bea97de94a931d2840fb284b620772cb376e2007fd33f8dba4241f0f78d2faa13', 'id': '61faafaf-335e-4d25-acb1-8f7f5e964dff', 'created_at': datetime.datetime(2026, 7, 15, 16, 42, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 42, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61faafaf-335e-4d25-acb1-8f7f5e964dff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639d850f-44a9-4409-8a4e-73a26783ae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:27 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Volume volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 (798d4101-11a1-48bd-95fe-1a332c5fbb64): created successfully Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639d850f-44a9-4409-8a4e-73a26783ae70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Flow 'volume_create_manager' (4c0c954b-8ad2-46c9-b4c0-fece30f9c138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5b5e2873-91c3-4cd9-a3d4-25b126779da3 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Created volume successfully. Jul 15 18:42:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Acquiring lock "cinder-798d4101-11a1-48bd-95fe-1a332c5fbb64-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Lock "cinder-798d4101-11a1-48bd-95fe-1a332c5fbb64-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Acquiring lock "cinder-quobyte-798d4101-11a1-48bd-95fe-1a332c5fbb64" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Lock "cinder-quobyte-798d4101-11a1-48bd-95fe-1a332c5fbb64" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:28 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ef309-c3b7-4114-8fd1-1ab64bbca9f6]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:28 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 Jul 15 18:42:28 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:29 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64" returned: 0 in 0.390s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:29 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 Jul 15 18:42:29 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:29 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64" returned: 1 in 0.425s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:29 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64 Jul 15 18:42:29 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:29 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-798d4101-11a1-48bd-95fe-1a332c5fbb64" returned: 0 in 0.287s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Lock "cinder-quobyte-798d4101-11a1-48bd-95fe-1a332c5fbb64" released by "delete_volume" :: held 1.187s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:30 devstack cinder-volume[87863]: WARNING cinder.quota [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:42:30 devstack cinder-volume[87863]: WARNING cinder.quota [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Created reservations ['047b9ecb-e5a2-455c-8c5e-13d698464353', 'da0b87a7-2249-495b-a9e8-a1d1fad2f058', 'dd455acc-e47b-4ebf-b288-1a4a9d6def10', '5db3f042-a595-4e10-ba80-999d90ffb4b6'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:30 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:30 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:30 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.337s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:30 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Deleted volume successfully. Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Flow 'volume_create_manager' (89c1f424-b863-4181-afe5-3944418b4b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6ff087-8121-407c-8a0a-dd83a7a9002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6ff087-8121-407c-8a0a-dd83a7a9002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-392812136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053b17b0-6933-4e08-9418-b6c415c06a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3734410cc4de43208462207c2478c901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:30Z,use_quota=True,user_id='41a96d069ad84e9c80ea7cc3ecad58bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2d5f9a-bd5e-44de-b34b-cf481e465721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2d5f9a-bd5e-44de-b34b-cf481e465721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e9f74d-9a88-4c70-be27-b79c510fbe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e9f74d-9a88-4c70-be27-b79c510fbe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '053b17b0-6933-4e08-9418-b6c415c06a0a', 'volume_name': 'volume-053b17b0-6933-4e08-9418-b6c415c06a0a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55eaf5c7-3623-405c-90ba-e5fa64268c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55eaf5c7-3623-405c-90ba-e5fa64268c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087abc0b-2f3c-41aa-ae52-ae71ae711b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:30 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Volume 053b17b0-6933-4e08-9418-b6c415c06a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-053b17b0-6933-4e08-9418-b6c415c06a0a', 'volume_size': 1} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-392812136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053b17b0-6933-4e08-9418-b6c415c06a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3734410cc4de43208462207c2478c901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:30Z,use_quota=True,user_id='41a96d069ad84e9c80ea7cc3ecad58bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Creating volume 053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:30 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6d0d307a-8242-4eaf-a2b7-11be8bc583f5 tempest-VolumeAndVolumeTypeFromImageTest-1059144374 None] Lock "cinder-798d4101-11a1-48bd-95fe-1a332c5fbb64-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:30 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a 1073741824 Jul 15 18:42:30 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:31 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a 1073741824" returned: 0 in 0.551s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:31 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a Jul 15 18:42:31 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:31 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a" returned: 0 in 0.315s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087abc0b-2f3c-41aa-ae52-ae71ae711b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053b17b0-6933-4e08-9418-b6c415c06a0a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2907a6e3-da86-4eef-93ed-1f8ad5b0b365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Volume volume-053b17b0-6933-4e08-9418-b6c415c06a0a (053b17b0-6933-4e08-9418-b6c415c06a0a): created successfully Jul 15 18:42:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2907a6e3-da86-4eef-93ed-1f8ad5b0b365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Flow 'volume_create_manager' (89c1f424-b863-4181-afe5-3944418b4b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-92961ac9-afba-4bbd-a9bf-ad1fc7b961b4 tempest-VolumesSnapshotListTestJSON-426480209 None] Created volume successfully. Jul 15 18:42:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Creating offline snapshot ca536c5d-9435-453f-84fc-9bd7197e4923 of volume 053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[259d5ad1-e92f-4268-8095-120b5ef91c5e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:33 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a Jul 15 18:42:33 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:33 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a" returned: 0 in 0.445s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:33 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 1G Jul 15 18:42:33 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Flow 'volume_create_manager' (445cfd8e-2035-4a75-bf76-1e0c9466d43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae1dace-d6c7-45e4-af14-b79dc5d64aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae1dace-d6c7-45e4-af14-b79dc5d64aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1349978236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f3a048-fad5-4e41-87c5-287e59bd9537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8878dc96938a413cbcb53af7ce7e26aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:34Z,use_quota=True,user_id='4481b99aa0f244e0a06f433c7307e496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fc6f8a-9d8d-402f-887d-bc4a4ad4eba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fc6f8a-9d8d-402f-887d-bc4a4ad4eba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd22650-85f1-470e-8581-4298508baf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd22650-85f1-470e-8581-4298508baf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f3a048-fad5-4e41-87c5-287e59bd9537', 'volume_name': 'volume-48f3a048-fad5-4e41-87c5-287e59bd9537', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ee278d-5dc7-4ff9-a0a1-e1e46b8521a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ee278d-5dc7-4ff9-a0a1-e1e46b8521a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052f59c0-2ed0-4ec4-b34a-97bd132fdf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Volume 48f3a048-fad5-4e41-87c5-287e59bd9537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f3a048-fad5-4e41-87c5-287e59bd9537', 'volume_size': 1} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:33 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 1G" returned: 0 in 0.458s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b17b0-6933-4e08-9418-b6c415c06a0a -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:33 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b17b0-6933-4e08-9418-b6c415c06a0a -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 Jul 15 18:42:33 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:34 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b17b0-6933-4e08-9418-b6c415c06a0a -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923" returned: 0 in 0.305s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:34 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 is being set with open permissions: ugo+rw Jul 15 18:42:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:34 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 Jul 15 18:42:34 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:34 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923" returned: 0 in 0.270s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:34 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.info Jul 15 18:42:34 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:34 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.info" returned: 0 in 0.259s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:34 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.info is being set with open permissions: ugo+rw Jul 15 18:42:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:34 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.info Jul 15 18:42:34 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:35 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.info" returned: 0 in 0.250s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1349978236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f3a048-fad5-4e41-87c5-287e59bd9537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8878dc96938a413cbcb53af7ce7e26aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:34Z,use_quota=True,user_id='4481b99aa0f244e0a06f433c7307e496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Creating volume 48f3a048-fad5-4e41-87c5-287e59bd9537 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:35 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:35 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537 1073741824 Jul 15 18:42:35 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:35 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8d3fdcb9-b84a-4474-b68e-2967bdc763c1 tempest-VolumesSnapshotListTestJSON-426480209 None] Create snapshot completed successfully Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:35 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:35 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:35 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.294s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:42:35 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537 1073741824" returned: 0 in 0.485s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:35 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537 Jul 15 18:42:35 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:35 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537" returned: 0 in 0.287s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052f59c0-2ed0-4ec4-b34a-97bd132fdf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f3a048-fad5-4e41-87c5-287e59bd9537', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0291e3-dda9-4c8e-8838-1f5088124482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:35 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Volume volume-48f3a048-fad5-4e41-87c5-287e59bd9537 (48f3a048-fad5-4e41-87c5-287e59bd9537): created successfully Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0291e3-dda9-4c8e-8838-1f5088124482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Flow 'volume_create_manager' (445cfd8e-2035-4a75-bf76-1e0c9466d43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:35 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-697a1763-e48c-41e1-b878-eff19958013b tempest-VolumesListAdminTestJSON-131480010 None] Created volume successfully. Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Flow 'volume_create_manager' (6096b113-c1e4-4eec-8ab8-64e193fb5969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0128c707-2688-4090-91a1-5c8761924e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0128c707-2688-4090-91a1-5c8761924e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922359328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4338138-9226-4368-a1f4-a520b5d28d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc662c401ca42c19745f63fae84b0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:36Z,use_quota=True,user_id='f4b2eca522d84d1a8b2b034af8c4d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34712899-a2dd-4c4e-820e-9f2dd1548625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34712899-a2dd-4c4e-820e-9f2dd1548625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e06edec-91bb-4dd9-b7d4-b502f836be23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e06edec-91bb-4dd9-b7d4-b502f836be23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4338138-9226-4368-a1f4-a520b5d28d36', 'volume_name': 'volume-c4338138-9226-4368-a1f4-a520b5d28d36', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee93f0df-50df-447e-9a61-15b161a1a8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee93f0df-50df-447e-9a61-15b161a1a8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756f9a57-589f-4e80-9816-88fa90d267db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Volume c4338138-9226-4368-a1f4-a520b5d28d36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4338138-9226-4368-a1f4-a520b5d28d36', 'volume_size': 1} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922359328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4338138-9226-4368-a1f4-a520b5d28d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc662c401ca42c19745f63fae84b0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:36Z,use_quota=True,user_id='f4b2eca522d84d1a8b2b034af8c4d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Creating volume c4338138-9226-4368-a1f4-a520b5d28d36 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:36 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:36 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36 1073741824 Jul 15 18:42:36 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Flow 'volume_create_manager' (319f19b9-f50e-4463-99cf-ea040ca412f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a2c181-0699-40d7-8846-cefdf6c75e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a2c181-0699-40d7-8846-cefdf6c75e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1998839570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df31b131-dacf-4eb3-9e90-19d7791aaf2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc662c401ca42c19745f63fae84b0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:36Z,use_quota=True,user_id='f4b2eca522d84d1a8b2b034af8c4d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d0d640-83c5-48d9-9168-14f69532645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d0d640-83c5-48d9-9168-14f69532645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8239b2b7-2079-4529-89d0-0f815dd96989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8239b2b7-2079-4529-89d0-0f815dd96989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df31b131-dacf-4eb3-9e90-19d7791aaf2d', 'volume_name': 'volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924e6b80-c318-441d-bbbf-7fa4407cf62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924e6b80-c318-441d-bbbf-7fa4407cf62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c9f557-6364-4848-b05d-ef94b83490fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Volume df31b131-dacf-4eb3-9e90-19d7791aaf2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d', 'volume_size': 1} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:36 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36 1073741824" returned: 0 in 0.607s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:36 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36 Jul 15 18:42:36 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Flow 'volume_create_manager' (fff40a99-ea72-45a3-8da8-d39d8d49542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4c7242-d149-45cb-8049-5d764396f944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4c7242-d149-45cb-8049-5d764396f944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624082086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac18fde9-b7e6-4712-9c3f-1014579d2d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc662c401ca42c19745f63fae84b0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:37Z,use_quota=True,user_id='f4b2eca522d84d1a8b2b034af8c4d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2012405-6b5e-4581-b794-82d0458e0483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2012405-6b5e-4581-b794-82d0458e0483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2c5c0f-27d3-4a1e-9614-e5329030d926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2c5c0f-27d3-4a1e-9614-e5329030d926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac18fde9-b7e6-4712-9c3f-1014579d2d0d', 'volume_name': 'volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f6e544-b700-4d28-b13f-6d4b7ff489e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f6e544-b700-4d28-b13f-6d4b7ff489e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91ce81a-6099-4059-b6dd-ac9fe6e7960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Volume ac18fde9-b7e6-4712-9c3f-1014579d2d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d', 'volume_size': 1} Jul 15 18:42:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:37 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36" returned: 0 in 0.262s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.503s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756f9a57-589f-4e80-9816-88fa90d267db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4338138-9226-4368-a1f4-a520b5d28d36', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac266de9-53c9-4d80-ba9c-b68ff180196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] Creating offline snapshot 0a8570b2-9cb5-41ef-99bf-e65f3db12110 of volume 053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:42:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Volume volume-c4338138-9226-4368-a1f4-a520b5d28d36 (c4338138-9226-4368-a1f4-a520b5d28d36): created successfully Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac266de9-53c9-4d80-ba9c-b68ff180196b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Flow 'volume_create_manager' (6096b113-c1e4-4eec-8ab8-64e193fb5969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dbf328-6757-49f8-9248-348a25bb85aa]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-326cb284-8386-4b6d-9efc-07ce6c3ef95e tempest-CreateVolumesFromImageTest-901656694 None] Created volume successfully. Jul 15 18:42:37 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 Jul 15 18:42:37 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Flow 'volume_create_manager' (9f0fe97a-0bd0-4283-ac49-e346d2e0c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fea282b-bd49-4178-ada5-442ead8d3d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fea282b-bd49-4178-ada5-442ead8d3d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-278326586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0e121d-24b6-4732-a599-69f26d40721f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc662c401ca42c19745f63fae84b0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:37Z,use_quota=True,user_id='f4b2eca522d84d1a8b2b034af8c4d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e10cc68-35a9-49a7-b29e-799e9f74c553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e10cc68-35a9-49a7-b29e-799e9f74c553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43260bde-bcb7-4553-b6f9-00f4679fc02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43260bde-bcb7-4553-b6f9-00f4679fc02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba0e121d-24b6-4732-a599-69f26d40721f', 'volume_name': 'volume-ba0e121d-24b6-4732-a599-69f26d40721f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5244e27-c282-44c0-b1a8-4c3a6128e0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5244e27-c282-44c0-b1a8-4c3a6128e0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c53585d-4ecd-40d0-8e27-d7f7cbbaca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Volume ba0e121d-24b6-4732-a599-69f26d40721f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba0e121d-24b6-4732-a599-69f26d40721f', 'volume_size': 1} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Flow 'volume_create_manager' (9e307c0f-e8a7-416e-a318-9fe6b8e9c796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7a9543-ff43-44a6-981d-45ea867d184f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7a9543-ff43-44a6-981d-45ea867d184f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2030002250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f664422-a061-49e4-8821-edc24ee7ec52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8878dc96938a413cbcb53af7ce7e26aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:38Z,use_quota=True,user_id='4481b99aa0f244e0a06f433c7307e496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e9ad22-d562-4716-9b00-785fab2900bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e9ad22-d562-4716-9b00-785fab2900bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fc0f7d-cdc1-458d-a835-36aff283dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fc0f7d-cdc1-458d-a835-36aff283dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f664422-a061-49e4-8821-edc24ee7ec52', 'volume_name': 'volume-2f664422-a061-49e4-8821-edc24ee7ec52', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84e4c04-d61f-408e-a4a8-f8881a810f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84e4c04-d61f-408e-a4a8-f8881a810f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266ef236-bad1-4ba4-9312-dfffb4b4e712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Volume 2f664422-a061-49e4-8821-edc24ee7ec52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f664422-a061-49e4-8821-edc24ee7ec52', 'volume_size': 1} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923" returned: 0 in 0.676s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-053b17b0-6933-4e08-9418-b6c415c06a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:37 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 1G Jul 15 18:42:37 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Flow 'volume_create_manager' (67a31d8a-cd1c-4d2d-95f1-6be6eb6b0ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8269c3b1-3cc9-4242-98e9-f47bc1e20d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8269c3b1-3cc9-4242-98e9-f47bc1e20d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1346833465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f385880a-8ac2-44e2-90ee-0577b856a390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc662c401ca42c19745f63fae84b0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:38Z,use_quota=True,user_id='f4b2eca522d84d1a8b2b034af8c4d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8721d5-d576-4f66-bac0-6f72eeeeb270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8721d5-d576-4f66-bac0-6f72eeeeb270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa27c27b-04be-404c-84d5-74737a9eb3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa27c27b-04be-404c-84d5-74737a9eb3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f385880a-8ac2-44e2-90ee-0577b856a390', 'volume_name': 'volume-f385880a-8ac2-44e2-90ee-0577b856a390', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca384b5-1d9a-486f-ab28-e7a371f972e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca384b5-1d9a-486f-ab28-e7a371f972e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8370d29-2914-482f-a394-1be79a008e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Volume f385880a-8ac2-44e2-90ee-0577b856a390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f385880a-8ac2-44e2-90ee-0577b856a390', 'volume_size': 1} Jul 15 18:42:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:38 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 1G" returned: 0 in 0.429s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:38 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 Jul 15 18:42:38 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:38 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110" returned: 0 in 0.308s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:38 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 is being set with open permissions: ugo+rw Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:38 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 Jul 15 18:42:38 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:38 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110" returned: 0 in 0.273s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.233s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1998839570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df31b131-dacf-4eb3-9e90-19d7791aaf2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc662c401ca42c19745f63fae84b0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:36Z,use_quota=True,user_id='f4b2eca522d84d1a8b2b034af8c4d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Creating volume df31b131-dacf-4eb3-9e90-19d7791aaf2d {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:38 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:38 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d 1073741824 Jul 15 18:42:38 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2799386f-000a-4e43-83b3-981957ed4657 tempest-VolumesSnapshotListTestJSON-426480209 None] Create snapshot completed successfully Jul 15 18:42:39 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d 1073741824" returned: 0 in 0.445s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:39 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d Jul 15 18:42:39 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:39 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d" returned: 0 in 0.263s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.710s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624082086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac18fde9-b7e6-4712-9c3f-1014579d2d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc662c401ca42c19745f63fae84b0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:37Z,use_quota=True,user_id='f4b2eca522d84d1a8b2b034af8c4d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Creating volume ac18fde9-b7e6-4712-9c3f-1014579d2d0d {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:39 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:39 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d 1073741824 Jul 15 18:42:39 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c9f557-6364-4848-b05d-ef94b83490fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567f06ac-7694-438f-998b-3d010541ff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:39 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Volume volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d (df31b131-dacf-4eb3-9e90-19d7791aaf2d): created successfully Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567f06ac-7694-438f-998b-3d010541ff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Flow 'volume_create_manager' (319f19b9-f50e-4463-99cf-ea040ca412f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:39 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3bdabad3-807e-432a-a6f4-d9b48a04572f tempest-CreateVolumesFromImageTest-901656694 None] Created volume successfully. Jul 15 18:42:40 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d 1073741824" returned: 0 in 0.464s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:40 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d Jul 15 18:42:40 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:40 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d" returned: 0 in 0.242s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.856s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-278326586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0e121d-24b6-4732-a599-69f26d40721f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc662c401ca42c19745f63fae84b0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:37Z,use_quota=True,user_id='f4b2eca522d84d1a8b2b034af8c4d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Creating volume ba0e121d-24b6-4732-a599-69f26d40721f {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:40 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91ce81a-6099-4059-b6dd-ac9fe6e7960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:40 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f 1073741824 Jul 15 18:42:40 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d84b02-0666-4655-9e44-614409ca6734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:40 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Volume volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d (ac18fde9-b7e6-4712-9c3f-1014579d2d0d): created successfully Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d84b02-0666-4655-9e44-614409ca6734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Flow 'volume_create_manager' (fff40a99-ea72-45a3-8da8-d39d8d49542c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:40 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-76a6c59f-77e7-4921-87fd-910537ce845b tempest-CreateVolumesFromImageTest-901656694 None] Created volume successfully. Jul 15 18:42:40 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f 1073741824" returned: 0 in 0.447s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:40 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f Jul 15 18:42:40 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:41 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f" returned: 0 in 0.242s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.308s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2030002250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f664422-a061-49e4-8821-edc24ee7ec52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8878dc96938a413cbcb53af7ce7e26aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:38Z,use_quota=True,user_id='4481b99aa0f244e0a06f433c7307e496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Creating volume 2f664422-a061-49e4-8821-edc24ee7ec52 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:41 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c53585d-4ecd-40d0-8e27-d7f7cbbaca6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0e121d-24b6-4732-a599-69f26d40721f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d637409b-a5b2-4389-90eb-143386edf377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:41 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52 1073741824 Jul 15 18:42:41 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:41 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Volume volume-ba0e121d-24b6-4732-a599-69f26d40721f (ba0e121d-24b6-4732-a599-69f26d40721f): created successfully Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d637409b-a5b2-4389-90eb-143386edf377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Flow 'volume_create_manager' (9f0fe97a-0bd0-4283-ac49-e346d2e0c8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:41 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-cb7d2b2c-b234-41e3-9098-489fc33b063d tempest-CreateVolumesFromImageTest-901656694 None] Created volume successfully. Jul 15 18:42:41 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52 1073741824" returned: 0 in 0.426s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:41 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52 Jul 15 18:42:41 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:41 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52" returned: 0 in 0.251s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.905s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1346833465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f385880a-8ac2-44e2-90ee-0577b856a390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc662c401ca42c19745f63fae84b0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:38Z,use_quota=True,user_id='f4b2eca522d84d1a8b2b034af8c4d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Creating volume f385880a-8ac2-44e2-90ee-0577b856a390 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:41 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266ef236-bad1-4ba4-9312-dfffb4b4e712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f664422-a061-49e4-8821-edc24ee7ec52', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc58bb0-b540-4c19-b0ab-00ca50c62562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:41 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390 1073741824 Jul 15 18:42:41 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:41 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Volume volume-2f664422-a061-49e4-8821-edc24ee7ec52 (2f664422-a061-49e4-8821-edc24ee7ec52): created successfully Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc58bb0-b540-4c19-b0ab-00ca50c62562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Flow 'volume_create_manager' (9e307c0f-e8a7-416e-a318-9fe6b8e9c796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:41 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1b15886e-b449-406a-b2dd-a74af6666ea0 tempest-VolumesListAdminTestJSON-131480010 None] Created volume successfully. Jul 15 18:42:42 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390 1073741824" returned: 0 in 0.453s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:42 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390 Jul 15 18:42:42 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:42 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390" returned: 0 in 0.244s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.875s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8370d29-2914-482f-a394-1be79a008e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f385880a-8ac2-44e2-90ee-0577b856a390', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0530d01f-1b5b-4f42-9df6-b0513c5dcfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] Creating offline snapshot 76fb7fe5-55c4-4376-bdaa-653eaec624d7 of volume 053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:42:42 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Volume volume-f385880a-8ac2-44e2-90ee-0577b856a390 (f385880a-8ac2-44e2-90ee-0577b856a390): created successfully Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0530d01f-1b5b-4f42-9df6-b0513c5dcfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Flow 'volume_create_manager' (67a31d8a-cd1c-4d2d-95f1-6be6eb6b0ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[171c8b48-3a0c-423e-aab7-32b988787168]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:42 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-703fe21b-53e9-4b0b-b6c8-ace6105d4be7 tempest-CreateVolumesFromImageTest-901656694 None] Created volume successfully. Jul 15 18:42:42 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 Jul 15 18:42:42 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:43 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110" returned: 0 in 0.427s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-053b17b0-6933-4e08-9418-b6c415c06a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:43 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 1G Jul 15 18:42:43 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Flow 'volume_create_manager' (10a2cf07-69c4-4525-a427-96462423ff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0b630e-a004-42b3-966d-054831842d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0b630e-a004-42b3-966d-054831842d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-761229887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c7522a-c433-4505-b2b0-b882abf5a0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8878dc96938a413cbcb53af7ce7e26aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:43Z,use_quota=True,user_id='4481b99aa0f244e0a06f433c7307e496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876e52db-80aa-4494-9097-e379f9d81216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876e52db-80aa-4494-9097-e379f9d81216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d3eed0-adee-4db3-9f70-bbb1593a4d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d3eed0-adee-4db3-9f70-bbb1593a4d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c7522a-c433-4505-b2b0-b882abf5a0b4', 'volume_name': 'volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628dd8e1-6dac-4af4-98be-592f31423853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628dd8e1-6dac-4af4-98be-592f31423853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73afff18-4900-499f-89c3-baf9728541fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:43 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Volume f5c7522a-c433-4505-b2b0-b882abf5a0b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4', 'volume_size': 1} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "cinder-f385880a-8ac2-44e2-90ee-0577b856a390-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-f385880a-8ac2-44e2-90ee-0577b856a390-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "cinder-quobyte-f385880a-8ac2-44e2-90ee-0577b856a390" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-quobyte-f385880a-8ac2-44e2-90ee-0577b856a390" acquired by "delete_volume" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[98143c53-71c1-4d66-8ec2-7c509ae96bb5]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:43 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390 Jul 15 18:42:43 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:43 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 1G" returned: 0 in 0.547s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:43 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 Jul 15 18:42:43 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:43 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390" returned: 0 in 0.390s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:43 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390 Jul 15 18:42:43 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:43 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7" returned: 0 in 0.317s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:43 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 is being set with open permissions: ugo+rw Jul 15 18:42:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:44 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 Jul 15 18:42:44 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:44 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f385880a-8ac2-44e2-90ee-0577b856a390" returned: 0 in 0.270s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-quobyte-f385880a-8ac2-44e2-90ee-0577b856a390" released by "delete_volume" :: held 0.707s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Created reservations ['79f57f33-8c40-4b6c-bcbe-6ec278b42b23', '3d4219ef-2ab9-46a0-8278-5fa5e216d83a', '60c8bb0c-c462-40c5-a2aa-03b8fedffe2d', '84c75a82-a8b6-4e4e-9043-669f123cef49'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:44 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7" returned: 0 in 0.267s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.702s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.964s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-761229887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c7522a-c433-4505-b2b0-b882abf5a0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8878dc96938a413cbcb53af7ce7e26aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:43Z,use_quota=True,user_id='4481b99aa0f244e0a06f433c7307e496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Creating volume f5c7522a-c433-4505-b2b0-b882abf5a0b4 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:44 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:44 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4 1073741824 Jul 15 18:42:44 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:44 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-61fee35e-4321-476e-a296-2fa2272f70a2 tempest-VolumesSnapshotListTestJSON-426480209 None] Create snapshot completed successfully Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:44 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:44 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "cinder-ba0e121d-24b6-4732-a599-69f26d40721f-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-ba0e121d-24b6-4732-a599-69f26d40721f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:44 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.304s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:44 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Deleted volume successfully. Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "cinder-quobyte-ba0e121d-24b6-4732-a599-69f26d40721f" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-quobyte-ba0e121d-24b6-4732-a599-69f26d40721f" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-511035d0-1491-4f28-a655-1c2592c802d8 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-f385880a-8ac2-44e2-90ee-0577b856a390-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee634f6e-f869-4eb7-8cb1-1ea7c5e72c4d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:44 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f Jul 15 18:42:44 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:44 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4 1073741824" returned: 0 in 0.572s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:44 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4 Jul 15 18:42:44 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:45 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f" returned: 0 in 0.440s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:45 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4" returned: 0 in 0.285s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73afff18-4900-499f-89c3-baf9728541fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:45 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3945a7fe-cc9a-4a3e-8a04-4a6b9778f517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:45 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Volume volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4 (f5c7522a-c433-4505-b2b0-b882abf5a0b4): created successfully Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3945a7fe-cc9a-4a3e-8a04-4a6b9778f517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Flow 'volume_create_manager' (10a2cf07-69c4-4525-a427-96462423ff9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-678737be-65cd-4d26-881a-64a82b6ee998 tempest-VolumesListAdminTestJSON-131480010 None] Created volume successfully. Jul 15 18:42:45 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ba0e121d-24b6-4732-a599-69f26d40721f" returned: 0 in 0.295s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-quobyte-ba0e121d-24b6-4732-a599-69f26d40721f" released by "delete_volume" :: held 0.782s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Created reservations ['fb346360-811e-42cd-8bb7-4fec3e12bf02', '84120000-cb11-4bf1-9b4d-6fd6f4f188f4', 'c2118478-b869-4221-b409-19dedb1a9538', 'ef2fcae3-3dd8-4214-a1f9-6f35fdd726b7'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:45 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:45 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-76fb7fe5-55c4-4376-bdaa-653eaec624d7-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-76fb7fe5-55c4-4376-bdaa-653eaec624d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "cinder-ac18fde9-b7e6-4712-9c3f-1014579d2d0d-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-quobyte-76fb7fe5-55c4-4376-bdaa-653eaec624d7" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-ac18fde9-b7e6-4712-9c3f-1014579d2d0d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-76fb7fe5-55c4-4376-bdaa-653eaec624d7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Deleting offline snapshot 76fb7fe5-55c4-4376-bdaa-653eaec624d7 of volume 053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] snapshot_file for this snap is: volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4531fa-8abd-4adb-9867-f62191f5a1d5]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "cinder-quobyte-ac18fde9-b7e6-4712-9c3f-1014579d2d0d" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-quobyte-ac18fde9-b7e6-4712-9c3f-1014579d2d0d" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[405a9c69-e5a0-4e10-ac4a-5c3a88ddce0f]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:45 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.313s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:45 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Deleted volume successfully. Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1572260c-a772-41f9-8bcf-2c7f0525de8c tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-ba0e121d-24b6-4732-a599-69f26d40721f-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:46 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 Jul 15 18:42:46 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:46 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d Jul 15 18:42:46 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:46 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7" returned: 0 in 0.424s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-053b17b0-6933-4e08-9418-b6c415c06a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[136df5a1-e447-4df7-b710-c8edd70c8068]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:46 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d" returned: 0 in 0.413s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:46 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d Jul 15 18:42:46 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:46 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 Jul 15 18:42:46 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:46 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac18fde9-b7e6-4712-9c3f-1014579d2d0d" returned: 0 in 0.277s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-quobyte-ac18fde9-b7e6-4712-9c3f-1014579d2d0d" released by "delete_volume" :: held 0.736s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Created reservations ['aa63b96a-4d35-4fb1-988b-262112853e69', '2109ab5d-8853-4451-8dda-d894a6d2b137', 'ab35a3e6-cdb5-46cf-9cc4-a15557738af1', '76c1c48c-cd32-4ab4-9aa6-562b5eca65ed'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:46 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110" returned: 0 in 0.430s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-053b17b0-6933-4e08-9418-b6c415c06a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:46 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 Jul 15 18:42:46 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:46 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:46 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "cinder-df31b131-dacf-4eb3-9e90-19d7791aaf2d-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-df31b131-dacf-4eb3-9e90-19d7791aaf2d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "cinder-quobyte-df31b131-dacf-4eb3-9e90-19d7791aaf2d" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-quobyte-df31b131-dacf-4eb3-9e90-19d7791aaf2d" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:47 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.310s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:47 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Deleted volume successfully. Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02ae1dc-8252-49ad-80fa-166609fb41a9]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3b586039-0c0a-4ce8-9779-9cfdc69b8c27 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-ac18fde9-b7e6-4712-9c3f-1014579d2d0d-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Flow 'volume_create_manager' (ba9dff35-d8ec-4af1-bdd2-04e866450776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fbb86e-4f4b-485c-aa6d-65841610e408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:47 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d Jul 15 18:42:47 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fbb86e-4f4b-485c-aa6d-65841610e408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5739e8e0-8828-4648-b6b5-2c54cbb2bd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc90c3b1378e43d99f4f6eb78d749552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:47Z,use_quota=True,user_id='2c7393f65cff46cc9777e8e21551c15c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6fdf12-a878-4e4e-b0c0-75f6347760fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6fdf12-a878-4e4e-b0c0-75f6347760fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e0033a-2594-4d63-83db-9acb225b5402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e0033a-2594-4d63-83db-9acb225b5402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5739e8e0-8828-4648-b6b5-2c54cbb2bd5b', 'volume_name': 'volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344f7de6-ffb8-4bda-8e11-33b6606579cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344f7de6-ffb8-4bda-8e11-33b6606579cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4e1dcd-abb9-4c8d-9a22-ab2302eacff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:47 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Volume 5739e8e0-8828-4648-b6b5-2c54cbb2bd5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b', 'volume_size': 1} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5739e8e0-8828-4648-b6b5-2c54cbb2bd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc90c3b1378e43d99f4f6eb78d749552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:47Z,use_quota=True,user_id='2c7393f65cff46cc9777e8e21551c15c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Creating volume 5739e8e0-8828-4648-b6b5-2c54cbb2bd5b {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:47 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:47 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7" returned: 0 in 0.598s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:47 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b 1073741824 Jul 15 18:42:47 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:47 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7 Jul 15 18:42:47 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:47 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d" returned: 0 in 0.429s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:47 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d Jul 15 18:42:47 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:47 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.76fb7fe5-55c4-4376-bdaa-653eaec624d7" returned: 0 in 0.307s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-76fb7fe5-55c4-4376-bdaa-653eaec624d7" released by "_delete_snapshot" :: held 1.881s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" released by "delete_snapshot" :: held 1.915s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Created reservations ['de1d134b-e10a-4e62-a22d-4098e31492e6', '8cf97826-ebab-40d3-9365-ce4e417e3a81', '0f844950-76b3-4e43-8a4b-d47451dd35a1', 'a71840d3-8148-47a4-b395-21f1239c9dae'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:47 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b 1073741824" returned: 0 in 0.504s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:47 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df31b131-dacf-4eb3-9e90-19d7791aaf2d" returned: 0 in 0.295s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:47 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Delete snapshot completed successfully. Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-quobyte-df31b131-dacf-4eb3-9e90-19d7791aaf2d" released by "delete_volume" :: held 0.785s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-627f01f0-d8e8-437c-ad6a-2f31081f7e4d tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-76fb7fe5-55c4-4376-bdaa-653eaec624d7-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-0a8570b2-9cb5-41ef-99bf-e65f3db12110-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:47 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b Jul 15 18:42:47 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-0a8570b2-9cb5-41ef-99bf-e65f3db12110-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-quobyte-0a8570b2-9cb5-41ef-99bf-e65f3db12110" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Created reservations ['95b68b49-2a27-428b-8d34-6323cf6c440a', '1842aaae-2a66-4d8e-9cde-1c30e70ad9cc', '89c67141-890e-4f06-b2a0-5c035c6105c3', '3adf425e-93cc-4871-a1dd-bb2df50db1a6'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-0a8570b2-9cb5-41ef-99bf-e65f3db12110" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Deleting offline snapshot 0a8570b2-9cb5-41ef-99bf-e65f3db12110 of volume 053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] snapshot_file for this snap is: volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ed9989-e553-4214-b598-a0da23f06b6f]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:48 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:48 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "cinder-c4338138-9226-4368-a1f4-a520b5d28d36-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:48 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 Jul 15 18:42:48 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-c4338138-9226-4368-a1f4-a520b5d28d36-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:48 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b" returned: 0 in 0.368s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4e1dcd-abb9-4c8d-9a22-ab2302eacff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b540110-eef7-4a6f-93fc-c734a6c2db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "cinder-quobyte-c4338138-9226-4368-a1f4-a520b5d28d36" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:48 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Volume volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b (5739e8e0-8828-4648-b6b5-2c54cbb2bd5b): created successfully Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b540110-eef7-4a6f-93fc-c734a6c2db6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Flow 'volume_create_manager' (ba9dff35-d8ec-4af1-bdd2-04e866450776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-quobyte-c4338138-9226-4368-a1f4-a520b5d28d36" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a97c1b28-b6e1-4aa1-aa47-95fc7310ae4e tempest-VolumesListAdminTestJSON-1634354966 None] Created volume successfully. Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94286ea-63e8-4fa3-b570-69a016b73712]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:48 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.327s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Deleted volume successfully. Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f2208314-c75f-4ffe-ac03-d059e78de4fa tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-df31b131-dacf-4eb3-9e90-19d7791aaf2d-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:48 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36 Jul 15 18:42:48 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:48 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110" returned: 0 in 0.518s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-053b17b0-6933-4e08-9418-b6c415c06a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6187e06b-af8e-46be-8175-09d33da85804]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:48 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 Jul 15 18:42:48 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:48 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36" returned: 0 in 0.429s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:48 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36 Jul 15 18:42:48 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:49 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923" returned: 0 in 0.397s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-053b17b0-6933-4e08-9418-b6c415c06a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:49 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 Jul 15 18:42:49 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:49 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c4338138-9226-4368-a1f4-a520b5d28d36" returned: 0 in 0.246s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-quobyte-c4338138-9226-4368-a1f4-a520b5d28d36" released by "delete_volume" :: held 0.744s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Created reservations ['a9f4e0ba-5dc6-4db3-820f-5229075e6455', '82b067b0-16ca-462e-8d42-3f8f5fe18285', '69979b95-d520-471c-b23d-db78c2ece657', '2c0d4d82-63b8-4591-82d7-b584c1d387d7'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:49 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:49 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Acquiring lock "cinder-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Lock "cinder-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:49 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110" returned: 0 in 0.530s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Acquiring lock "cinder-quobyte-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:49 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Lock "cinder-quobyte-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:49 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110 Jul 15 18:42:49 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.344s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:49 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Deleted volume successfully. Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82dcc67-81ef-494f-bc8e-eba9e09b2e65]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c20b704-9b35-4d51-a0de-9637a15367b7 tempest-CreateVolumesFromImageTest-901656694 None] Lock "cinder-c4338138-9226-4368-a1f4-a520b5d28d36-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "cinder-f5c7522a-c433-4505-b2b0-b882abf5a0b4-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-f5c7522a-c433-4505-b2b0-b882abf5a0b4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "cinder-quobyte-f5c7522a-c433-4505-b2b0-b882abf5a0b4" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:49 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b Jul 15 18:42:49 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-quobyte-f5c7522a-c433-4505-b2b0-b882abf5a0b4" acquired by "delete_volume" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c775946-da0c-4c25-b654-09f5a791f772]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:50 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.0a8570b2-9cb5-41ef-99bf-e65f3db12110" returned: 0 in 0.467s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:50 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4 Jul 15 18:42:50 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-0a8570b2-9cb5-41ef-99bf-e65f3db12110" released by "_delete_snapshot" :: held 2.062s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" released by "delete_snapshot" :: held 2.098s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:50 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b" returned: 0 in 0.604s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Created reservations ['c5cdfea7-c565-4f7a-87c8-44c0b005c75f', 'a2682cab-1e0d-4552-9665-e89f2db2d211', '7c6d8e14-d8d2-402c-a6ed-caf072bf6a52', 'c41c005a-1d99-491b-bb4f-24a667d1b221'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:50 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b Jul 15 18:42:50 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Delete snapshot completed successfully. Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7a62684e-f090-4179-b30d-eb7d0405b076 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-0a8570b2-9cb5-41ef-99bf-e65f3db12110-delete_snapshot" released by "delete_snapshot" :: held 2.388s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:50 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4" returned: 0 in 0.563s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:50 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4 Jul 15 18:42:50 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:50 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b" returned: 0 in 0.364s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Lock "cinder-quobyte-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b" released by "delete_volume" :: held 1.032s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Created reservations ['24325a58-99fc-4852-a47d-74d5dab44e7a', '4c196f1b-4e11-4cc7-aeac-9740164dfb44', '12f90524-b57b-434b-a51d-f00e5eb53385', '62ec20b0-2b0b-4d0b-a948-7c4fd03c658a'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:50 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:50 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:50 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f5c7522a-c433-4505-b2b0-b882abf5a0b4" returned: 0 in 0.356s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-quobyte-f5c7522a-c433-4505-b2b0-b882abf5a0b4" released by "delete_volume" :: held 0.990s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Created reservations ['e0f1b710-540e-4f62-be10-8209bd7372f3', 'c917f73d-22f5-40a7-8e15-29ebbba1055c', '801a079a-6aac-4553-b752-b5cc835de55d', '656017dd-a612-4158-a6a9-abbd33c363c2'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:51 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:51 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:51 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.282s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:51 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Deleted volume successfully. Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8e9f518b-0d4c-4b14-bfeb-e00b0597aa61 tempest-VolumesListAdminTestJSON-1634354966 None] Lock "cinder-5739e8e0-8828-4648-b6b5-2c54cbb2bd5b-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-ca536c5d-9435-453f-84fc-9bd7197e4923-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-ca536c5d-9435-453f-84fc-9bd7197e4923-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-quobyte-ca536c5d-9435-453f-84fc-9bd7197e4923" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-ca536c5d-9435-453f-84fc-9bd7197e4923" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Deleting offline snapshot ca536c5d-9435-453f-84fc-9bd7197e4923 of volume 053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:42:51 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] snapshot_file for this snap is: volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.362s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:51 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Deleted volume successfully. Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7007817-1ffd-4370-abf1-62e38cbed749]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d1630a74-4fe8-4af8-905b-a5f8b5901ba9 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-f5c7522a-c433-4505-b2b0-b882abf5a0b4-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:51 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 Jul 15 18:42:51 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:51 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923" returned: 0 in 0.395s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-053b17b0-6933-4e08-9418-b6c415c06a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e31291-831e-4d8f-8ed3-d5cad93840dd]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:51 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a Jul 15 18:42:51 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "cinder-2f664422-a061-49e4-8821-edc24ee7ec52-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-2f664422-a061-49e4-8821-edc24ee7ec52-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "cinder-quobyte-2f664422-a061-49e4-8821-edc24ee7ec52" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:52 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a" returned: 0 in 0.390s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-quobyte-2f664422-a061-49e4-8821-edc24ee7ec52" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:52 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 Jul 15 18:42:52 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79ed4e8-5d36-46d8-975c-e4ee0874c90b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:52 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52 Jul 15 18:42:52 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:52 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923" returned: 0 in 0.345s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:52 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923 Jul 15 18:42:52 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:52 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52" returned: 0 in 0.388s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:52 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52 Jul 15 18:42:52 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:52 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a.ca536c5d-9435-453f-84fc-9bd7197e4923" returned: 0 in 0.258s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-ca536c5d-9435-453f-84fc-9bd7197e4923" released by "_delete_snapshot" :: held 1.503s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" released by "delete_snapshot" :: held 1.531s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:52 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2f664422-a061-49e4-8821-edc24ee7ec52" returned: 0 in 0.261s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-quobyte-2f664422-a061-49e4-8821-edc24ee7ec52" released by "delete_volume" :: held 0.699s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Created reservations ['7b1bf2af-ed17-47b8-8d11-97087725ef4b', 'a9b41f68-340d-4eb4-92a1-39410154e2fd', 'de006778-8457-47f8-ae66-a100d9dc831c', 'e70353d3-8107-4f79-9bb7-f51d42b61b88'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Created reservations ['da83ddd4-ddab-4874-8092-59ec987c21cd', '8ee57c13-6f18-48fa-bff1-6eb09656a331', '6ae59c24-9399-4ba6-bbcc-bcbc32b00fdd', 'd5aa2767-d34d-4c1e-946f-1869671853db'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:52 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Delete snapshot completed successfully. Jul 15 18:42:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-769f7476-f52a-4155-b958-16480d49d968 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-ca536c5d-9435-453f-84fc-9bd7197e4923-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:53 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:53 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:53 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:53 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Deleted volume successfully. Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-709ecf09-9326-4ca5-a323-ba807e5c9af6 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-2f664422-a061-49e4-8821-edc24ee7ec52-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "cinder-48f3a048-fad5-4e41-87c5-287e59bd9537-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-48f3a048-fad5-4e41-87c5-287e59bd9537-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "cinder-quobyte-48f3a048-fad5-4e41-87c5-287e59bd9537" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-quobyte-48f3a048-fad5-4e41-87c5-287e59bd9537" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f921c05-a306-416a-b9de-48a89a89ef4c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-053b17b0-6933-4e08-9418-b6c415c06a0a-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-053b17b0-6933-4e08-9418-b6c415c06a0a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:53 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537 Jul 15 18:42:53 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb61fbc-50bf-4fcb-8386-47fa260092c2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:53 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a Jul 15 18:42:53 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:53 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537" returned: 0 in 0.400s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:53 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537 Jul 15 18:42:53 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:54 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a" returned: 0 in 0.363s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:54 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a Jul 15 18:42:54 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:54 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-48f3a048-fad5-4e41-87c5-287e59bd9537" returned: 0 in 0.272s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-quobyte-48f3a048-fad5-4e41-87c5-287e59bd9537" released by "delete_volume" :: held 0.719s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Created reservations ['eb71e76b-ffd9-4ccb-99d8-a5cad030068d', 'd9ffe8fc-efb1-44b1-b1d3-86301d2b5448', '70e9b557-9a50-4be8-8c4e-35108197cd5d', 'b10b0730-72b7-49b3-9d35-a8e776206c4b'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:54 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-053b17b0-6933-4e08-9418-b6c415c06a0a" returned: 0 in 0.305s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:54 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:54 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-quobyte-053b17b0-6933-4e08-9418-b6c415c06a0a" released by "delete_volume" :: held 0.726s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Created reservations ['39430145-7bb5-48b3-bb53-49c35daf5f32', 'dd156a63-5d5d-4a05-b228-99a9cd289cbb', 'b617cd95-fcbd-4070-8f0f-fa45fdf31a66', 'fd04b6e9-eb8b-4c79-97f3-d0cf46810eb7'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:54 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:42:54 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:54 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.273s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Deleted volume successfully. Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a476a846-993f-4172-8d3b-f06ab9a16424 tempest-VolumesListAdminTestJSON-131480010 None] Lock "cinder-48f3a048-fad5-4e41-87c5-287e59bd9537-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:54 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.309s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Deleted volume successfully. Jul 15 18:42:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-160ba5d9-e042-46a4-9aab-7d7079fb13a8 tempest-VolumesSnapshotListTestJSON-426480209 None] Lock "cinder-053b17b0-6933-4e08-9418-b6c415c06a0a-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=132,cinder:INSERT=54,cinder:UPDATE=174,cinder:DELETE=12 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=136,cinder:UPDATE=190,cinder:INSERT=42,cinder:DELETE=19 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Flow 'volume_create_manager' (5d920ee7-a06f-4382-bd5e-2e8eab27b836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536966e1-f655-443b-9ef3-af44068a70a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536966e1-f655-443b-9ef3-af44068a70a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-430494013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111e7553-d5d3-4107-b4c6-cc303e9f62e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5795d132308c4a7bb128d11b66ca138c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:58Z,use_quota=True,user_id='2e1190a85af849599fc6ba8fc3b69653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b280d417-01c1-4786-ba39-221dec5dea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b280d417-01c1-4786-ba39-221dec5dea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a5901f-9aae-41c9-8402-fb04c24e2975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a5901f-9aae-41c9-8402-fb04c24e2975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111e7553-d5d3-4107-b4c6-cc303e9f62e6', 'volume_name': 'volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6', 'volume_size': 2}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf263d6-ad9d-41ec-819d-a8ee85d7200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf263d6-ad9d-41ec-819d-a8ee85d7200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cd1267-94a5-4854-813e-2d633e2aef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:58 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Volume 111e7553-d5d3-4107-b4c6-cc303e9f62e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6', 'volume_size': 2} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-430494013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111e7553-d5d3-4107-b4c6-cc303e9f62e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5795d132308c4a7bb128d11b66ca138c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:58Z,use_quota=True,user_id='2e1190a85af849599fc6ba8fc3b69653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Creating volume 111e7553-d5d3-4107-b4c6-cc303e9f62e6 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:58 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 2147483648 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:58 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 2147483648 Jul 15 18:42:58 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:58 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 2147483648" returned: 0 in 0.550s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:58 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 Jul 15 18:42:58 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:59 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6" returned: 0 in 0.277s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cd1267-94a5-4854-813e-2d633e2aef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6', 'volume_size': 2}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dee38cc-ebe8-40ba-b8ca-96a37d60f14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:59 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Volume volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 (111e7553-d5d3-4107-b4c6-cc303e9f62e6): created successfully Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dee38cc-ebe8-40ba-b8ca-96a37d60f14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Flow 'volume_create_manager' (5d920ee7-a06f-4382-bd5e-2e8eab27b836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-af746ec7-951e-4eb0-84ae-298990aaa408 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Created volume successfully. Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Flow 'volume_create_manager' (baca934b-0113-4a0d-992c-a11dd795d5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcd40ba-92a7-4c5b-8744-225e04612e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcd40ba-92a7-4c5b-8744-225e04612e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1822775654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919ed50e-6252-4fae-9727-2d48f475e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ca701002164ed59c06bc41de2c01bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:59Z,use_quota=True,user_id='040965950b27481cbb54f9af605e29a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538e34c3-cabd-4d83-ac11-87ea654add92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538e34c3-cabd-4d83-ac11-87ea654add92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9047335-a03b-4a81-ad06-e2f31e2c065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9047335-a03b-4a81-ad06-e2f31e2c065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '919ed50e-6252-4fae-9727-2d48f475e79d', 'volume_name': 'volume-919ed50e-6252-4fae-9727-2d48f475e79d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7e631d-30e6-40c0-9ec3-462d8e7c04a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7e631d-30e6-40c0-9ec3-462d8e7c04a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3649eb2f-abfa-43da-89e5-752ed695ffde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:59 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Volume 919ed50e-6252-4fae-9727-2d48f475e79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-919ed50e-6252-4fae-9727-2d48f475e79d', 'volume_size': 1} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1822775654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919ed50e-6252-4fae-9727-2d48f475e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ca701002164ed59c06bc41de2c01bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:59Z,use_quota=True,user_id='040965950b27481cbb54f9af605e29a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Creating volume 919ed50e-6252-4fae-9727-2d48f475e79d {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:59 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:59 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d 1073741824 Jul 15 18:42:59 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:59 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d 1073741824" returned: 0 in 0.433s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:59 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d Jul 15 18:42:59 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:00 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d" returned: 0 in 0.263s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3649eb2f-abfa-43da-89e5-752ed695ffde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-919ed50e-6252-4fae-9727-2d48f475e79d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752dbfe4-53a3-4831-900d-5766a95b0b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:00 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Volume volume-919ed50e-6252-4fae-9727-2d48f475e79d (919ed50e-6252-4fae-9727-2d48f475e79d): created successfully Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752dbfe4-53a3-4831-900d-5766a95b0b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Flow 'volume_create_manager' (baca934b-0113-4a0d-992c-a11dd795d5ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-93f58516-506a-4e26-b6da-e4528d5ba9be tempest-VolumesDeleteCascade-1803447315 None] Created volume successfully. Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Creating offline snapshot 4c91dff8-d477-4d6e-84b4-9be0df9d5c79 of volume 111e7553-d5d3-4107-b4c6-cc303e9f62e6 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cad971-61ef-41f4-b1b1-c343bf7d9bd1]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:00 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 Jul 15 18:43:00 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:00 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6" returned: 0 in 0.351s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 2G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:01 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 2G Jul 15 18:43:01 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:01 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 2G" returned: 0 in 0.386s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:01 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 Jul 15 18:43:01 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:01 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79" returned: 0 in 0.281s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:01 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 is being set with open permissions: ugo+rw Jul 15 18:43:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:01 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 Jul 15 18:43:01 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:01 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:01 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.info Jul 15 18:43:01 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:02 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.info" returned: 0 in 0.244s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:02 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.info is being set with open permissions: ugo+rw Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:02 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.info Jul 15 18:43:02 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:02 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.info" returned: 0 in 0.242s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.792s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Creating offline snapshot bbb11421-5d30-4bad-84d4-9f9be7bf2285 of volume 919ed50e-6252-4fae-9727-2d48f475e79d {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c648c0-9370-49ca-b2af-a7ce4949afaf]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:02 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-37ae2afa-ecd4-4773-bc12-c97ceaf9c988 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Create snapshot completed successfully Jul 15 18:43:02 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d Jul 15 18:43:02 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Acquiring lock "cinder-4c91dff8-d477-4d6e-84b4-9be0df9d5c79-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "cinder-4c91dff8-d477-4d6e-84b4-9be0df9d5c79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Acquiring lock "cinder-quobyte-111e7553-d5d3-4107-b4c6-cc303e9f62e6" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "cinder-quobyte-111e7553-d5d3-4107-b4c6-cc303e9f62e6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Acquiring lock "cinder-quobyte-4c91dff8-d477-4d6e-84b4-9be0df9d5c79" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "cinder-quobyte-4c91dff8-d477-4d6e-84b4-9be0df9d5c79" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Deleting offline snapshot 4c91dff8-d477-4d6e-84b4-9be0df9d5c79 of volume 111e7553-d5d3-4107-b4c6-cc303e9f62e6 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] snapshot_file for this snap is: volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[777f84ef-fbe8-4d15-bf05-346951d90156]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:02 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d" returned: 0 in 0.367s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:02 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 1G Jul 15 18:43:02 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:02 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 Jul 15 18:43:02 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:03 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79" returned: 0 in 0.376s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde1966c-37f2-408a-ac61-9848e0ec14c2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:03 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 1G" returned: 0 in 0.428s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-919ed50e-6252-4fae-9727-2d48f475e79d -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:03 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-919ed50e-6252-4fae-9727-2d48f475e79d -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 Jul 15 18:43:03 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:03 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 Jul 15 18:43:03 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:03 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-919ed50e-6252-4fae-9727-2d48f475e79d -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285" returned: 0 in 0.303s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:03 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 is being set with open permissions: ugo+rw Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:03 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 Jul 15 18:43:03 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:03 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6" returned: 0 in 0.395s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:03 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 Jul 15 18:43:03 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:03 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285" returned: 0 in 0.252s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:03 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.info Jul 15 18:43:03 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:04 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79" returned: 0 in 0.385s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:04 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79 Jul 15 18:43:04 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:04 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.info" returned: 0 in 0.266s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:04 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.info is being set with open permissions: ugo+rw Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:04 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.info Jul 15 18:43:04 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:04 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6.4c91dff8-d477-4d6e-84b4-9be0df9d5c79" returned: 0 in 0.255s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "cinder-quobyte-4c91dff8-d477-4d6e-84b4-9be0df9d5c79" released by "_delete_snapshot" :: held 1.517s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "cinder-quobyte-111e7553-d5d3-4107-b4c6-cc303e9f62e6" released by "delete_snapshot" :: held 1.549s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Created reservations ['96fae473-fb3f-480f-8973-1743adfd8802', '6de1d7f5-51a4-4636-873b-a178ff42df0c', 'bf3e7892-417d-4c6a-b5c3-85082e602e34', 'f0b6143f-58d2-4cc1-aec7-8eb53821f64b'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:04 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.info" returned: 0 in 0.258s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:04 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-11535ce0-bd5b-421f-9341-f9f8e409e840 tempest-VolumesDeleteCascade-1803447315 None] Create snapshot completed successfully Jul 15 18:43:04 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Delete snapshot completed successfully. Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3774177f-5694-4a6f-be7a-93cd2f8324d3 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "cinder-4c91dff8-d477-4d6e-84b4-9be0df9d5c79-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] Creating offline snapshot 10069886-aeab-4cd6-96c3-a26239f033a0 of volume 919ed50e-6252-4fae-9727-2d48f475e79d {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:43:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Acquiring lock "cinder-111e7553-d5d3-4107-b4c6-cc303e9f62e6-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[116f8c04-70cb-4960-aaf7-48794e8a1182]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "cinder-111e7553-d5d3-4107-b4c6-cc303e9f62e6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Acquiring lock "cinder-quobyte-111e7553-d5d3-4107-b4c6-cc303e9f62e6" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "cinder-quobyte-111e7553-d5d3-4107-b4c6-cc303e9f62e6" acquired by "delete_volume" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6583b4da-14ad-46d7-a4eb-228dddb1e1b2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:05 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 Jul 15 18:43:05 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:05 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 Jul 15 18:43:05 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:05 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285" returned: 0 in 0.382s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-919ed50e-6252-4fae-9727-2d48f475e79d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:05 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 1G Jul 15 18:43:05 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:05 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6" returned: 0 in 0.363s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:05 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6 Jul 15 18:43:05 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:05 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-111e7553-d5d3-4107-b4c6-cc303e9f62e6" returned: 0 in 0.265s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "cinder-quobyte-111e7553-d5d3-4107-b4c6-cc303e9f62e6" released by "delete_volume" :: held 0.686s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Created reservations ['770eb9b7-1726-430e-afe6-e3826a562bab', '2c04a018-15e1-4d93-9bc9-c89c0e2ae696', 'b470ca33-6880-4eac-a180-ac7fe9153606', '46b36e48-4933-4724-8295-9b95f8fbda0d'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:05 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 1G" returned: 0 in 0.439s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:05 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 Jul 15 18:43:05 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:05 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:43:05 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:06 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0" returned: 0 in 0.317s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:06 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 is being set with open permissions: ugo+rw Jul 15 18:43:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:06 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.261s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:06 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Deleted volume successfully. Jul 15 18:43:06 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 Jul 15 18:43:06 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1a199865-ea95-4da6-af38-c6429efd5395 tempest-VolumesSnapshotNegativeTestJSON-38664665 None] Lock "cinder-111e7553-d5d3-4107-b4c6-cc303e9f62e6-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:06 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0" returned: 0 in 0.269s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.516s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5ff4241d-03c6-4c27-a1bd-514f994129d8 tempest-VolumesDeleteCascade-1803447315 None] Create snapshot completed successfully Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-919ed50e-6252-4fae-9727-2d48f475e79d-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-919ed50e-6252-4fae-9727-2d48f475e79d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Performing cascade delete. {{(pid=87863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-10069886-aeab-4cd6-96c3-a26239f033a0-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-10069886-aeab-4cd6-96c3-a26239f033a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-919ed50e-6252-4fae-9727-2d48f475e79d" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-919ed50e-6252-4fae-9727-2d48f475e79d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-10069886-aeab-4cd6-96c3-a26239f033a0" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-10069886-aeab-4cd6-96c3-a26239f033a0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Deleting offline snapshot 10069886-aeab-4cd6-96c3-a26239f033a0 of volume 919ed50e-6252-4fae-9727-2d48f475e79d {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] snapshot_file for this snap is: volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[082ecfba-922d-4599-9d93-b7cae33b3f50]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:07 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 Jul 15 18:43:07 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:07 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0" returned: 0 in 0.395s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-919ed50e-6252-4fae-9727-2d48f475e79d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d36e5bd-e68b-450d-aa00-30ad7e7297ef]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:07 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 Jul 15 18:43:07 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:08 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285" returned: 0 in 0.385s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-919ed50e-6252-4fae-9727-2d48f475e79d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:08 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 Jul 15 18:43:08 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:08 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0" returned: 0 in 0.398s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:08 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0 Jul 15 18:43:08 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:08 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.10069886-aeab-4cd6-96c3-a26239f033a0" returned: 0 in 0.268s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-10069886-aeab-4cd6-96c3-a26239f033a0" released by "_delete_snapshot" :: held 1.556s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-919ed50e-6252-4fae-9727-2d48f475e79d" released by "delete_snapshot" :: held 1.583s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Created reservations ['a32b0645-3167-4159-a08a-ad04cf3f551e', 'f4e6c482-ae2e-4f72-9f2f-76571ac00f42', '89e6050c-d4e4-4dd0-bfd4-bd0cd82059f0', '53717ef5-248d-4cf3-9e70-ecca340f9b96'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:08 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Delete snapshot completed successfully. Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-10069886-aeab-4cd6-96c3-a26239f033a0-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-bbb11421-5d30-4bad-84d4-9f9be7bf2285-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-bbb11421-5d30-4bad-84d4-9f9be7bf2285-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-919ed50e-6252-4fae-9727-2d48f475e79d" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-919ed50e-6252-4fae-9727-2d48f475e79d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-bbb11421-5d30-4bad-84d4-9f9be7bf2285" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-bbb11421-5d30-4bad-84d4-9f9be7bf2285" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Deleting offline snapshot bbb11421-5d30-4bad-84d4-9f9be7bf2285 of volume 919ed50e-6252-4fae-9727-2d48f475e79d {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:43:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] snapshot_file for this snap is: volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:43:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb91395-d538-4682-89f1-daa467daf972]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:09 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 Jul 15 18:43:09 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:09 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285" returned: 0 in 0.396s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-919ed50e-6252-4fae-9727-2d48f475e79d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[662674fb-e1e4-406a-adc3-117a5de09dd1]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:09 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d Jul 15 18:43:09 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:09 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d" returned: 0 in 0.387s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:09 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 Jul 15 18:43:09 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:10 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285" returned: 0 in 0.372s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:10 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285 Jul 15 18:43:10 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:10 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d.bbb11421-5d30-4bad-84d4-9f9be7bf2285" returned: 0 in 0.268s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-bbb11421-5d30-4bad-84d4-9f9be7bf2285" released by "_delete_snapshot" :: held 1.524s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-919ed50e-6252-4fae-9727-2d48f475e79d" released by "delete_snapshot" :: held 1.553s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Created reservations ['6fc2a640-0aa7-4114-b7ec-689f0a94e3ba', 'f526377b-ad9e-4f2e-88cf-c2852b46255f', '84fba239-f348-4211-a08c-9c4acfa83d39', '1a034ac6-96eb-4898-a5de-be226c63517c'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:10 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Delete snapshot completed successfully. Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-bbb11421-5d30-4bad-84d4-9f9be7bf2285-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Snapshots deleted, issuing volume delete {{(pid=87863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-919ed50e-6252-4fae-9727-2d48f475e79d" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-919ed50e-6252-4fae-9727-2d48f475e79d" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[836be1dd-982e-4ee8-9a79-f7f54c44dce4]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:10 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d Jul 15 18:43:10 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:11 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d" returned: 0 in 0.389s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:11 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d Jul 15 18:43:11 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:11 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-919ed50e-6252-4fae-9727-2d48f475e79d" returned: 0 in 0.255s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-919ed50e-6252-4fae-9727-2d48f475e79d" released by "delete_volume" :: held 0.710s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Created reservations ['2e8272ff-1afc-49ae-8834-45d1acbc95fc', '082756e0-c9b5-4775-9f90-c595c9447cdf', 'a53d4dd5-d409-498d-a1cf-06db76399202', 'c24bfbec-566d-45a0-bce4-a9e251cc6107'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:11 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:43:11 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:11 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.278s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:11 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Deleted volume successfully. Jul 15 18:43:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7ecf02ca-50ea-4af2-98e3-a16bb3bea08c tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-919ed50e-6252-4fae-9727-2d48f475e79d-delete_volume" released by "delete_volume" :: held 4.758s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Flow 'volume_create_manager' (3a25ce8b-9bde-47bf-92a1-9c2a6580aed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17823d5a-505c-44f2-b029-1b3e4a77cb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17823d5a-505c-44f2-b029-1b3e4a77cb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-568693632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98d845d-6dae-4488-921c-8208f532ee4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ca701002164ed59c06bc41de2c01bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:13Z,use_quota=True,user_id='040965950b27481cbb54f9af605e29a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f287ec4-3a4b-459e-b9ea-9adc500a92cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f287ec4-3a4b-459e-b9ea-9adc500a92cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3fda21-54ad-4821-b81f-c1498ee64d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3fda21-54ad-4821-b81f-c1498ee64d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98d845d-6dae-4488-921c-8208f532ee4e', 'volume_name': 'volume-f98d845d-6dae-4488-921c-8208f532ee4e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648d0a17-38f1-47b9-89a8-974ba5d05dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648d0a17-38f1-47b9-89a8-974ba5d05dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816b08d0-720d-41c1-bbea-4ec50d8112af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:13 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Volume f98d845d-6dae-4488-921c-8208f532ee4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98d845d-6dae-4488-921c-8208f532ee4e', 'volume_size': 1} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-568693632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98d845d-6dae-4488-921c-8208f532ee4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ca701002164ed59c06bc41de2c01bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:13Z,use_quota=True,user_id='040965950b27481cbb54f9af605e29a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Creating volume f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:13 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:13 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e 1073741824 Jul 15 18:43:13 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:13 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e 1073741824" returned: 0 in 0.488s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:13 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e Jul 15 18:43:13 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:14 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e" returned: 0 in 0.280s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816b08d0-720d-41c1-bbea-4ec50d8112af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98d845d-6dae-4488-921c-8208f532ee4e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60718dd-bc98-497c-9ca4-aaaa95999f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:14 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Volume volume-f98d845d-6dae-4488-921c-8208f532ee4e (f98d845d-6dae-4488-921c-8208f532ee4e): created successfully Jul 15 18:43:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60718dd-bc98-497c-9ca4-aaaa95999f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Flow 'volume_create_manager' (3a25ce8b-9bde-47bf-92a1-9c2a6580aed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:14 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3f5be4a0-846c-4977-b8e4-f1e5743d5685 tempest-VolumesDeleteCascade-1803447315 None] Created volume successfully. Jul 15 18:43:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Creating offline snapshot 5c1cb94c-e4dd-4c68-b962-077097cd0c77 of volume f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:43:15 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb3869c-b839-485a-8ac6-04e435b7bc66]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:15 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e Jul 15 18:43:15 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:15 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e" returned: 0 in 0.401s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:16 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 1G Jul 15 18:43:16 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:16 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 1G" returned: 0 in 0.458s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98d845d-6dae-4488-921c-8208f532ee4e -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:16 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98d845d-6dae-4488-921c-8208f532ee4e -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 Jul 15 18:43:16 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:16 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98d845d-6dae-4488-921c-8208f532ee4e -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77" returned: 0 in 0.309s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:16 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 is being set with open permissions: ugo+rw Jul 15 18:43:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:16 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 Jul 15 18:43:16 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:17 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:17 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.info Jul 15 18:43:17 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:17 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.info" returned: 0 in 0.253s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:17 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.info is being set with open permissions: ugo+rw Jul 15 18:43:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:17 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.info Jul 15 18:43:17 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:17 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.info" returned: 0 in 0.239s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:17 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-dfb46764-ce26-4c6c-8acf-5fb2de743da3 tempest-VolumesDeleteCascade-1803447315 None] Create snapshot completed successfully Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Flow 'volume_create_manager' (33a8c0bd-aad6-4660-ac4b-57ebe663b5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06222e41-3754-47a3-8621-f768410eb57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06222e41-3754-47a3-8621-f768410eb57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-658662897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc3cf28-e952-4c9d-ad76-f6692e964142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ca701002164ed59c06bc41de2c01bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c1cb94c-e4dd-4c68-b962-077097cd0c77,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:19Z,use_quota=True,user_id='040965950b27481cbb54f9af605e29a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8231279d-b164-4898-94b6-593e505c5747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8231279d-b164-4898-94b6-593e505c5747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac89de08-e3b8-45db-8db8-c87ad992773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac89de08-e3b8-45db-8db8-c87ad992773c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3cc3cf28-e952-4c9d-ad76-f6692e964142', 'volume_name': 'volume-3cc3cf28-e952-4c9d-ad76-f6692e964142', 'volume_size': 1, 'snapshot_id': '5c1cb94c-e4dd-4c68-b962-077097cd0c77'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f415ed7-c478-4cb8-bd9b-1efc058dadf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f415ed7-c478-4cb8-bd9b-1efc058dadf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476d9014-902d-4303-b075-fed7bbba75b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:19 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Volume 3cc3cf28-e952-4c9d-ad76-f6692e964142: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3cc3cf28-e952-4c9d-ad76-f6692e964142', 'volume_size': 1, 'snapshot_id': '5c1cb94c-e4dd-4c68-b962-077097cd0c77'} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-5c1cb94c-e4dd-4c68-b962-077097cd0c77-3cc3cf28-e952-4c9d-ad76-f6692e964142" by "_create_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-5c1cb94c-e4dd-4c68-b962-077097cd0c77-3cc3cf28-e952-4c9d-ad76-f6692e964142" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Creating volume 3cc3cf28-e952-4c9d-ad76-f6692e964142 from snapshot 5c1cb94c-e4dd-4c68-b962-077097cd0c77 {{(pid=87863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-3cc3cf28-e952-4c9d-ad76-f6692e964142" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-3cc3cf28-e952-4c9d-ad76-f6692e964142" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] snapshot: 5c1cb94c-e4dd-4c68-b962-077097cd0c77, volume: 3cc3cf28-e952-4c9d-ad76-f6692e964142, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[282ee90e-4c9a-48e4-9893-f4d9c8133d76]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:19 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 Jul 15 18:43:19 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:19 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77" returned: 0 in 0.429s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98d845d-6dae-4488-921c-8208f532ee4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:43:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:43:20 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d43e4b8-d326-41a3-be58-c4f5f794869b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:20 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e Jul 15 18:43:20 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:20 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e" returned: 0 in 0.410s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:20 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:43:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:20 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 Jul 15 18:43:20 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:25 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142" returned: 0 in 4.930s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:25 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccdc3ab-a2b8-43f5-9cc7-5f25516c48e7]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:25 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e Jul 15 18:43:25 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:25 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e" returned: 0 in 0.574s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:25 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:43:25 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Converted 1024.00 MB image at 207.66 MB/s Jul 15 18:43:25 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 is being set with open permissions: ugo+rw Jul 15 18:43:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:25 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 Jul 15 18:43:25 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:26 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142" returned: 0 in 0.245s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-3cc3cf28-e952-4c9d-ad76-f6692e964142" released by "_copy_volume_from_snapshot" :: held 6.700s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-5c1cb94c-e4dd-4c68-b962-077097cd0c77-3cc3cf28-e952-4c9d-ad76-f6692e964142" released by "_create_volume_from_snapshot" :: held 6.737s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.755s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476d9014-902d-4303-b075-fed7bbba75b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc3cf28-e952-4c9d-ad76-f6692e964142', 'volume_size': 1, 'snapshot_id': '5c1cb94c-e4dd-4c68-b962-077097cd0c77'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc3e0aa-4436-4934-86c0-bd8cff0a9a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:26 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Volume volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 (3cc3cf28-e952-4c9d-ad76-f6692e964142): created successfully Jul 15 18:43:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc3e0aa-4436-4934-86c0-bd8cff0a9a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Flow 'volume_create_manager' (33a8c0bd-aad6-4660-ac4b-57ebe663b5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:26 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c4bac7e1-2c73-47a6-bba1-c66f575efb23 tempest-VolumesDeleteCascade-1803447315 None] Created volume successfully. Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-f98d845d-6dae-4488-921c-8208f532ee4e-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-f98d845d-6dae-4488-921c-8208f532ee4e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Performing cascade delete. {{(pid=87863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-5c1cb94c-e4dd-4c68-b962-077097cd0c77-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-5c1cb94c-e4dd-4c68-b962-077097cd0c77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-f98d845d-6dae-4488-921c-8208f532ee4e" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-f98d845d-6dae-4488-921c-8208f532ee4e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-5c1cb94c-e4dd-4c68-b962-077097cd0c77" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-5c1cb94c-e4dd-4c68-b962-077097cd0c77" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Deleting offline snapshot 5c1cb94c-e4dd-4c68-b962-077097cd0c77 of volume f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] snapshot_file for this snap is: volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a036c3-547c-4cdd-b30b-7b8e4d20459d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:27 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 Jul 15 18:43:27 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:27 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77" returned: 0 in 0.355s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98d845d-6dae-4488-921c-8208f532ee4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad482300-e133-42fa-b2a6-7980c948eb79]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:27 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e Jul 15 18:43:27 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:27 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e" returned: 0 in 0.429s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:28 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 Jul 15 18:43:28 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:28 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77" returned: 0 in 0.417s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:28 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77 Jul 15 18:43:28 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:28 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e.5c1cb94c-e4dd-4c68-b962-077097cd0c77" returned: 0 in 0.260s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-5c1cb94c-e4dd-4c68-b962-077097cd0c77" released by "_delete_snapshot" :: held 1.563s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-f98d845d-6dae-4488-921c-8208f532ee4e" released by "delete_snapshot" :: held 1.589s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Created reservations ['e553d32d-0d9e-43d6-ac5a-89e83e488791', '30039232-b4e9-47d9-9b4c-87fd44383606', '5d407668-935a-4661-9946-919df46c4e26', '757ddce4-772b-4cbe-b81f-e1709d9447e0'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:28 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Delete snapshot completed successfully. Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-5c1cb94c-e4dd-4c68-b962-077097cd0c77-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Snapshots deleted, issuing volume delete {{(pid=87863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-f98d845d-6dae-4488-921c-8208f532ee4e" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-f98d845d-6dae-4488-921c-8208f532ee4e" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af0684c-8f66-4bd1-b080-b9e01caf7b2b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:29 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e Jul 15 18:43:29 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:29 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e" returned: 0 in 0.406s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:29 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e Jul 15 18:43:29 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:29 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f98d845d-6dae-4488-921c-8208f532ee4e" returned: 0 in 0.259s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-f98d845d-6dae-4488-921c-8208f532ee4e" released by "delete_volume" :: held 0.732s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Created reservations ['aefad145-355b-42de-a363-9853ede9d97f', '6f42b6d9-3539-4695-9506-6d54614348ae', '805a3e73-4d64-4297-80a6-bdc0fc430673', '6a14d2db-e86b-4198-ad87-105c27d242ef'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:29 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:43:29 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:29 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.245s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:29 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:29 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Deleted volume successfully. Jul 15 18:43:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0791d88-219d-41b3-9397-a9a390422a20 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-f98d845d-6dae-4488-921c-8208f532ee4e-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-3cc3cf28-e952-4c9d-ad76-f6692e964142-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-3cc3cf28-e952-4c9d-ad76-f6692e964142-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "cinder-quobyte-3cc3cf28-e952-4c9d-ad76-f6692e964142" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-3cc3cf28-e952-4c9d-ad76-f6692e964142" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:30 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d91078e-8c05-4c1e-8ea4-e4e8361f5647]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:30 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 Jul 15 18:43:30 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:30 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142" returned: 0 in 0.377s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:31 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142 Jul 15 18:43:31 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:31 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3cc3cf28-e952-4c9d-ad76-f6692e964142" returned: 0 in 0.249s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-quobyte-3cc3cf28-e952-4c9d-ad76-f6692e964142" released by "delete_volume" :: held 0.676s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Created reservations ['7b1d24dd-c833-45aa-b685-1006cd68b28b', 'e4f9aace-541b-4251-88af-b236cab6e1a3', '273fd986-a215-4f88-bd99-f59a605445a9', '2345896b-d062-45c1-a310-d692ebd791b5'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:31 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:43:31 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:31 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.297s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Deleted volume successfully. Jul 15 18:43:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-81ded0f6-ad65-4696-aca5-4b4fc20122e3 tempest-VolumesDeleteCascade-1803447315 None] Lock "cinder-3cc3cf28-e952-4c9d-ad76-f6692e964142-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Flow 'volume_create_manager' (46541e68-0a1b-433d-99ce-198aafe0d9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd5968e-c731-4ea7-9454-50865061e011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd5968e-c731-4ea7-9454-50865061e011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-609957609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31ab5eb-e35d-4e19-995c-fbb4a3e644fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b01fb08464547c08e4c1d3242953160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:35Z,use_quota=True,user_id='7a76836c8b5f40869ae96fe6b953f179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a347db1-bb7f-412c-b1d0-6ee645e206e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a347db1-bb7f-412c-b1d0-6ee645e206e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1d400c-33fd-487b-93ae-12501ccba795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1d400c-33fd-487b-93ae-12501ccba795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c31ab5eb-e35d-4e19-995c-fbb4a3e644fd', 'volume_name': 'volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41f7566-025f-4470-b266-1a4aafaf72d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41f7566-025f-4470-b266-1a4aafaf72d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a923fe1-12b3-4939-b7e8-4089e5c61ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:34 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Volume c31ab5eb-e35d-4e19-995c-fbb4a3e644fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd', 'volume_size': 1} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-609957609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31ab5eb-e35d-4e19-995c-fbb4a3e644fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b01fb08464547c08e4c1d3242953160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:35Z,use_quota=True,user_id='7a76836c8b5f40869ae96fe6b953f179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Creating volume c31ab5eb-e35d-4e19-995c-fbb4a3e644fd {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:34 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:43:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:34 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd 1073741824 Jul 15 18:43:34 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:35 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:43:35 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:35 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd 1073741824" returned: 0 in 0.501s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:35 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.313s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:43:35 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd Jul 15 18:43:35 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:35 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd" returned: 0 in 0.270s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a923fe1-12b3-4939-b7e8-4089e5c61ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2a3fa9-3270-4e46-a9fa-1f79dbb5cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:35 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Volume volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd (c31ab5eb-e35d-4e19-995c-fbb4a3e644fd): created successfully Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2a3fa9-3270-4e46-a9fa-1f79dbb5cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Flow 'volume_create_manager' (46541e68-0a1b-433d-99ce-198aafe0d9cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:35 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a9c33fcf-c747-4a6b-9b5a-20da35308f5e tempest-VolumesMetadataTest-1674149920 None] Created volume successfully. Jul 15 18:43:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Acquiring lock "cinder-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Lock "cinder-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Acquiring lock "cinder-quobyte-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Lock "cinder-quobyte-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:37 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d065655-f5ad-4364-9695-c3d1c5a6c784]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:37 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd Jul 15 18:43:37 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:38 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd" returned: 0 in 0.397s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:38 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd Jul 15 18:43:38 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:38 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd" returned: 0 in 0.277s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Lock "cinder-quobyte-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd" released by "delete_volume" :: held 0.723s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Created reservations ['c5c23b33-042e-4745-8953-7b54dc935418', '7ef2ffaf-49d9-4edd-8660-76fbe68e6dfc', '9a3ad76e-c706-4fb5-b457-389cb709a44e', 'b5fa81f6-6b80-4e2a-8868-75401db78270'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:38 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:43:38 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:38 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.283s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Deleted volume successfully. Jul 15 18:43:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85cbb009-224a-4ea9-81bf-b7051d3d81bf tempest-VolumesMetadataTest-1674149920 None] Lock "cinder-c31ab5eb-e35d-4e19-995c-fbb4a3e644fd-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Flow 'volume_create_manager' (67c9582e-8914-4ac5-87a3-610e9e14d55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4649fd15-6fdb-4a88-bd44-9537ccc33d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4649fd15-6fdb-4a88-bd44-9537ccc33d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1675434391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32ce82d-8b8b-411c-86ac-0d584ead1bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182d3ba305f34d93b6bbec978b5f6426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:43Z,use_quota=True,user_id='4cbd751c4f6542fdbed88b3e689562a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bd4417-9e9b-4685-9307-e7338623b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bd4417-9e9b-4685-9307-e7338623b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af13d10a-bf70-4492-a86e-d92cf1c54684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af13d10a-bf70-4492-a86e-d92cf1c54684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32ce82d-8b8b-411c-86ac-0d584ead1bc7', 'volume_name': 'volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202659b9-895b-4c8e-818c-00a43c77d1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202659b9-895b-4c8e-818c-00a43c77d1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0055ae82-11e0-4c3f-a2f1-7e048c64b7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:42 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Volume f32ce82d-8b8b-411c-86ac-0d584ead1bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7', 'volume_size': 1} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1675434391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32ce82d-8b8b-411c-86ac-0d584ead1bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182d3ba305f34d93b6bbec978b5f6426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:43Z,use_quota=True,user_id='4cbd751c4f6542fdbed88b3e689562a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Creating volume f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:42 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:43:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:42 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 1073741824 Jul 15 18:43:42 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:43 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 1073741824" returned: 0 in 0.682s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:43 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 Jul 15 18:43:43 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:43 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7" returned: 0 in 0.266s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0055ae82-11e0-4c3f-a2f1-7e048c64b7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36443f81-01ac-4395-b522-68f27332f0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:43 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Volume volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 (f32ce82d-8b8b-411c-86ac-0d584ead1bc7): created successfully Jul 15 18:43:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36443f81-01ac-4395-b522-68f27332f0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Flow 'volume_create_manager' (67c9582e-8914-4ac5-87a3-610e9e14d55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:44 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3caaf502-d896-4b49-8757-e0b35aecb805 tempest-VolumesCloneTest-1045683125 None] Created volume successfully. Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Flow 'volume_create_manager' (84310578-780f-474e-969d-d727034692a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3470532-397b-4419-be67-d3fcfe726018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3470532-397b-4419-be67-d3fcfe726018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1022540149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e82d0b-a404-49c3-89e4-21173677a858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182d3ba305f34d93b6bbec978b5f6426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f32ce82d-8b8b-411c-86ac-0d584ead1bc7,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:45Z,use_quota=True,user_id='4cbd751c4f6542fdbed88b3e689562a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1f8345-1b8c-47db-b47f-66fda53700fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1f8345-1b8c-47db-b47f-66fda53700fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf08eb3-6de5-4914-9ea7-5220dc866477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf08eb3-6de5-4914-9ea7-5220dc866477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '58e82d0b-a404-49c3-89e4-21173677a858', 'volume_name': 'volume-58e82d0b-a404-49c3-89e4-21173677a858', 'volume_size': 2, 'source_volid': 'f32ce82d-8b8b-411c-86ac-0d584ead1bc7', 'source_volstatus': 'available'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ae4514-af79-4187-934a-8da4c68b0f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ae4514-af79-4187-934a-8da4c68b0f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dee55b-3d4f-4a26-bf97-351e9784b86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Volume 58e82d0b-a404-49c3-89e4-21173677a858: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-58e82d0b-a404-49c3-89e4-21173677a858', 'volume_size': 2, 'source_volid': 'f32ce82d-8b8b-411c-86ac-0d584ead1bc7', 'source_volstatus': 'available'} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:45 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Cloning volume f32ce82d-8b8b-411c-86ac-0d584ead1bc7 to volume 58e82d0b-a404-49c3-89e4-21173677a858 Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Creating offline snapshot ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc of volume f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[363c35dc-2533-409c-8883-898612bfe82b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:45 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 Jul 15 18:43:45 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Flow 'volume_create_manager' (b335fad1-2b7c-4f82-abff-837df97450a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42ecbc8-a6a5-4c2f-8fff-e42e4f445310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42ecbc8-a6a5-4c2f-8fff-e42e4f445310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-202021044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95951b4-5896-4ad3-9e3a-51061ad129c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10868a9b3e914cbd98e3da67b179ad7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:46Z,use_quota=True,user_id='e677dbb04dd148038ef8058ab4a21738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0b2226-06c7-4cec-b700-c68013641c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0b2226-06c7-4cec-b700-c68013641c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ee1824-a24c-4adc-aa4f-49f70ea7ce26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ee1824-a24c-4adc-aa4f-49f70ea7ce26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95951b4-5896-4ad3-9e3a-51061ad129c3', 'volume_name': 'volume-f95951b4-5896-4ad3-9e3a-51061ad129c3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2e44d4-e624-4a3a-9f32-3ffb3c262931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2e44d4-e624-4a3a-9f32-3ffb3c262931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa86e4d-007b-48ab-a089-c94ea275de46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Volume f95951b4-5896-4ad3-9e3a-51061ad129c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95951b4-5896-4ad3-9e3a-51061ad129c3', 'volume_size': 1} Jul 15 18:43:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:46 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7" returned: 0 in 0.394s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:46 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc 1G Jul 15 18:43:46 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:46 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc 1G" returned: 0 in 0.435s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:46 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc Jul 15 18:43:46 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:46 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc" returned: 0 in 0.298s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:46 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc is being set with open permissions: ugo+rw Jul 15 18:43:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:46 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc Jul 15 18:43:46 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:47 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc" returned: 0 in 0.251s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:47 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.info Jul 15 18:43:47 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:47 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.info" returned: 0 in 0.258s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:47 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.info is being set with open permissions: ugo+rw Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:47 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.info Jul 15 18:43:47 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:47 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.info" returned: 0 in 0.255s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Acquiring lock "cinder-quobyte-58e82d0b-a404-49c3-89e4-21173677a858" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Lock "cinder-quobyte-58e82d0b-a404-49c3-89e4-21173677a858" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] snapshot: ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc, volume: 58e82d0b-a404-49c3-89e4-21173677a858, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a691dd74-e800-4e7f-a038-266508507b9b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:47 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc Jul 15 18:43:47 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:48 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc" returned: 0 in 0.412s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:43:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:43:48 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[97147338-8da8-454c-abea-be97faef7a73]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:48 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 Jul 15 18:43:48 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:48 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7" returned: 0 in 0.386s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:48 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:43:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:48 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 Jul 15 18:43:48 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:54 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858" returned: 0 in 5.955s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:54 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5976fdb6-de3e-4c7e-87d0-7d7953e617d9]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:54 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 Jul 15 18:43:54 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:55 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7" returned: 0 in 0.564s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:43:55 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Converted 1024.00 MB image at 171.93 MB/s Jul 15 18:43:55 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 is being set with open permissions: ugo+rw Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:55 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 Jul 15 18:43:55 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:55 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858" returned: 0 in 0.259s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Lock "cinder-quobyte-58e82d0b-a404-49c3-89e4-21173677a858" released by "_copy_volume_from_snapshot" :: held 7.669s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Acquiring lock "cinder-quobyte-ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Lock "cinder-quobyte-ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Deleting offline snapshot ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc of volume f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] snapshot_file for this snap is: volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8291115b-e6c8-4f03-b05f-ef2a2475a2e1]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:55 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc Jul 15 18:43:55 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:55 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc" returned: 0 in 0.423s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2630f8f0-9b36-48b3-b6e8-43dc7c7c0494]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:55 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 Jul 15 18:43:55 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:56 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7" returned: 0 in 0.373s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:56 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc Jul 15 18:43:56 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:56 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc" returned: 0 in 0.314s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:56 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc Jul 15 18:43:56 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:56 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7.ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc" returned: 0 in 0.262s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Lock "cinder-quobyte-ae9ec7d1-eff8-40e3-9019-0a5dce4c5cdc" released by "_delete_snapshot" :: held 1.475s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.241s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.967s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-202021044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95951b4-5896-4ad3-9e3a-51061ad129c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10868a9b3e914cbd98e3da67b179ad7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:46Z,use_quota=True,user_id='e677dbb04dd148038ef8058ab4a21738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Creating volume f95951b4-5896-4ad3-9e3a-51061ad129c3 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:56 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:56 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 1073741824 Jul 15 18:43:56 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dee55b-3d4f-4a26-bf97-351e9784b86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e82d0b-a404-49c3-89e4-21173677a858', 'volume_size': 2, 'source_volid': 'f32ce82d-8b8b-411c-86ac-0d584ead1bc7', 'source_volstatus': 'available'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db094cf2-f913-4c7b-a136-d20643dbad1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:56 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Volume volume-58e82d0b-a404-49c3-89e4-21173677a858 (58e82d0b-a404-49c3-89e4-21173677a858): created successfully Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db094cf2-f913-4c7b-a136-d20643dbad1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Flow 'volume_create_manager' (84310578-780f-474e-969d-d727034692a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:56 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c79ca5c7-39b3-4c07-9031-0d9c88813fea tempest-VolumesCloneTest-1045683125 None] Created volume successfully. Jul 15 18:43:57 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 1073741824" returned: 0 in 0.455s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:57 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 Jul 15 18:43:57 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:57 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3" returned: 0 in 0.246s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa86e4d-007b-48ab-a089-c94ea275de46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95951b4-5896-4ad3-9e3a-51061ad129c3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914ec6cb-ec75-4cf0-87a6-522d1bfaca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:57 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Volume volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 (f95951b4-5896-4ad3-9e3a-51061ad129c3): created successfully Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914ec6cb-ec75-4cf0-87a6-522d1bfaca33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Flow 'volume_create_manager' (b335fad1-2b7c-4f82-abff-837df97450a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:57 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4cab2b53-014a-470c-b41f-1b05c648e4de tempest-TestMinimumBasicScenario-426376066 None] Created volume successfully. Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Acquiring lock "cinder-58e82d0b-a404-49c3-89e4-21173677a858-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Lock "cinder-58e82d0b-a404-49c3-89e4-21173677a858-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Acquiring lock "cinder-quobyte-58e82d0b-a404-49c3-89e4-21173677a858" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Lock "cinder-quobyte-58e82d0b-a404-49c3-89e4-21173677a858" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef37307a-0569-4adc-9772-a32968404b57]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:58 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 Jul 15 18:43:58 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:58 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858" returned: 0 in 0.394s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:58 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858 Jul 15 18:43:58 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:58 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-58e82d0b-a404-49c3-89e4-21173677a858" returned: 0 in 0.285s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Lock "cinder-quobyte-58e82d0b-a404-49c3-89e4-21173677a858" released by "delete_volume" :: held 0.727s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=92,cinder:INSERT=25,cinder:SELECT=78,cinder:DELETE=12 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=83,cinder:UPDATE=92,cinder:DELETE=5,cinder:INSERT=23 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Created reservations ['c30bffc3-a44c-4be8-ba96-31166fc12f8c', '4f0b5ad6-ebfd-402e-a5b2-dc8aeb580408', '53b1979f-53d8-4fa9-b87e-9b40c4ec5fcf', '6e2c8635-5f77-42f4-b1f5-4dc7016db256'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:58 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:43:58 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:59 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.283s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Deleted volume successfully. Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Acquiring lock "cinder-f32ce82d-8b8b-411c-86ac-0d584ead1bc7-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8cbfb72e-8394-4125-a72a-549b52ab96fb tempest-VolumesCloneTest-1045683125 None] Lock "cinder-58e82d0b-a404-49c3-89e4-21173677a858-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Lock "cinder-f32ce82d-8b8b-411c-86ac-0d584ead1bc7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Acquiring lock "cinder-quobyte-f32ce82d-8b8b-411c-86ac-0d584ead1bc7" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Lock "cinder-quobyte-f32ce82d-8b8b-411c-86ac-0d584ead1bc7" acquired by "delete_volume" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-bfc3954d-f4bb-4029-ba18-a12311f585d0 req-dc05329a-1108-4fbe-99ee-dcd91f69f924 tempest-TestMinimumBasicScenario-426376066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-bfc3954d-f4bb-4029-ba18-a12311f585d0 req-dc05329a-1108-4fbe-99ee-dcd91f69f924 tempest-TestMinimumBasicScenario-426376066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8af7b8-eab4-47c3-b15c-cd42c27dbc76]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e88f11e-03d1-40fe-9c6a-4266f84d4b26]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-bfc3954d-f4bb-4029-ba18-a12311f585d0 req-dc05329a-1108-4fbe-99ee-dcd91f69f924 tempest-TestMinimumBasicScenario-426376066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:59 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 Jul 15 18:43:59 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:59 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 Jul 15 18:43:59 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:59 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7" returned: 0 in 0.384s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:59 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-bfc3954d-f4bb-4029-ba18-a12311f585d0 req-dc05329a-1108-4fbe-99ee-dcd91f69f924 tempest-TestMinimumBasicScenario-426376066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3" returned: 0 in 0.388s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-bfc3954d-f4bb-4029-ba18-a12311f585d0 req-dc05329a-1108-4fbe-99ee-dcd91f69f924 tempest-TestMinimumBasicScenario-426376066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.412s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:59 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7 Jul 15 18:43:59 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-bfc3954d-f4bb-4029-ba18-a12311f585d0 req-dc05329a-1108-4fbe-99ee-dcd91f69f924 tempest-TestMinimumBasicScenario-426376066 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-f95951b4-5896-4ad3-9e3a-51061ad129c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05c78355-7c56-415b-b7e0-5dbc6ae49b32', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:43:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-bfc3954d-f4bb-4029-ba18-a12311f585d0 req-dc05329a-1108-4fbe-99ee-dcd91f69f924 tempest-TestMinimumBasicScenario-426376066 None] attachment_update completed successfully. Jul 15 18:43:59 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f32ce82d-8b8b-411c-86ac-0d584ead1bc7" returned: 0 in 0.270s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Lock "cinder-quobyte-f32ce82d-8b8b-411c-86ac-0d584ead1bc7" released by "delete_volume" :: held 0.728s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:00 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Created reservations ['f8531b16-f561-4136-9d83-36649ff9acc6', '96848dba-c966-4e87-94b6-4ef9e1c8181e', '154648fa-c6db-4e22-9909-000adb3858d3', '5a522ab7-45f1-4b1e-914c-275da5e25878'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:00 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:44:00 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:00 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.276s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:00 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Deleted volume successfully. Jul 15 18:44:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6fb66ea3-5c1f-4130-96df-790ae092adbe tempest-VolumesCloneTest-1045683125 None] Lock "cinder-f32ce82d-8b8b-411c-86ac-0d584ead1bc7-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:10 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=18 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:44:10 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:INSERT=4,cinder:UPDATE=16,cinder:SELECT=15,cinder:DELETE=2 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Flow 'volume_create_manager' (31fc83f9-028e-4906-8aa6-778dd46494f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6cb160-cf1f-4b61-adb6-165c1030cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6cb160-cf1f-4b61-adb6-165c1030cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1824788749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6ea452-a1c2-497d-a8cb-ba34953c6890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936b5cf4d8d44a50aedbafe476964902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:15Z,use_quota=True,user_id='12494f73a17b4922871c7b8782090c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13128053-c60c-4a96-9089-3a9222c02fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13128053-c60c-4a96-9089-3a9222c02fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37dd6a2c-bd87-4ebd-bf13-1b30f96916d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37dd6a2c-bd87-4ebd-bf13-1b30f96916d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6ea452-a1c2-497d-a8cb-ba34953c6890', 'volume_name': 'volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27438a35-de0b-4417-a7d4-6286aaed997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27438a35-de0b-4417-a7d4-6286aaed997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c950ddc-b4e0-4e6d-a22b-15ce9ae8540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:14 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Volume 4e6ea452-a1c2-497d-a8cb-ba34953c6890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890', 'volume_size': 1} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1824788749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6ea452-a1c2-497d-a8cb-ba34953c6890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936b5cf4d8d44a50aedbafe476964902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:15Z,use_quota=True,user_id='12494f73a17b4922871c7b8782090c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Creating volume 4e6ea452-a1c2-497d-a8cb-ba34953c6890 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:14 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:44:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:14 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 1073741824 Jul 15 18:44:14 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:15 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 1073741824" returned: 0 in 0.416s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:15 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 Jul 15 18:44:15 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:15 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890" returned: 0 in 0.242s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:44:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c950ddc-b4e0-4e6d-a22b-15ce9ae8540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a50ddf4-2978-4aac-b60e-4d09110026ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:15 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Volume volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 (4e6ea452-a1c2-497d-a8cb-ba34953c6890): created successfully Jul 15 18:44:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a50ddf4-2978-4aac-b60e-4d09110026ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Flow 'volume_create_manager' (31fc83f9-028e-4906-8aa6-778dd46494f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:15 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2790a612-ff8a-4e0d-bcc0-2031e7de3803 tempest-VolumesSnapshotTestJSON-17309257 None] Created volume successfully. Jul 15 18:44:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Creating offline snapshot 441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 of volume 4e6ea452-a1c2-497d-a8cb-ba34953c6890 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:44:16 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f021449b-d76e-4bdd-ad28-00201f2ca4e8]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:16 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 Jul 15 18:44:16 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:16 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890" returned: 0 in 0.359s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:16 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 1G Jul 15 18:44:16 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:16 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 1G" returned: 0 in 0.386s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:16 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 Jul 15 18:44:16 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:17 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8" returned: 0 in 0.280s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:17 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 is being set with open permissions: ugo+rw Jul 15 18:44:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:17 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 Jul 15 18:44:17 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:17 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8" returned: 0 in 0.235s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:17 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.info Jul 15 18:44:17 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:17 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.info" returned: 0 in 0.254s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:17 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.info is being set with open permissions: ugo+rw Jul 15 18:44:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:17 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.info Jul 15 18:44:17 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:17 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.info" returned: 0 in 0.252s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:17 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-0a348a13-25c7-4ea9-a78d-7ebc9d88ee75 tempest-VolumesSnapshotTestJSON-17309257 None] Create snapshot completed successfully Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-441dfa5d-d980-4a38-b8e1-fef3f44bf3c8-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-441dfa5d-d980-4a38-b8e1-fef3f44bf3c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-4e6ea452-a1c2-497d-a8cb-ba34953c6890" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-4e6ea452-a1c2-497d-a8cb-ba34953c6890" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-441dfa5d-d980-4a38-b8e1-fef3f44bf3c8" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-441dfa5d-d980-4a38-b8e1-fef3f44bf3c8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Deleting offline snapshot 441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 of volume 4e6ea452-a1c2-497d-a8cb-ba34953c6890 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] snapshot_file for this snap is: volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69ff2f5-4695-472f-afbb-97577f8b1736]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:18 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 Jul 15 18:44:18 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:18 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8" returned: 0 in 0.368s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d3db23-8ec0-4d4a-9713-8702cd36bba2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:18 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 Jul 15 18:44:18 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:19 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890" returned: 0 in 0.337s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:19 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 Jul 15 18:44:19 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:19 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8" returned: 0 in 0.321s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:19 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8 Jul 15 18:44:19 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:19 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890.441dfa5d-d980-4a38-b8e1-fef3f44bf3c8" returned: 0 in 0.254s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-441dfa5d-d980-4a38-b8e1-fef3f44bf3c8" released by "_delete_snapshot" :: held 1.387s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-4e6ea452-a1c2-497d-a8cb-ba34953c6890" released by "delete_snapshot" :: held 1.410s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:19 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Created reservations ['c4eea172-35f7-4cf0-8a49-860163786976', '2aa5d469-54a1-49f9-9a66-7948094d654b', '6ffe590e-56f6-4b69-8efa-dc8ed9099714', '56de1b49-3b3b-4acb-a975-6dbb390c11e5'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:19 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Delete snapshot completed successfully. Jul 15 18:44:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-29ded0d1-07bb-492a-aee3-dfa430cc923b tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-441dfa5d-d980-4a38-b8e1-fef3f44bf3c8-delete_snapshot" released by "delete_snapshot" :: held 1.577s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Flow 'volume_create_manager' (3f0c9da2-7913-4b50-bd25-3ee359c3e00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ccbfa2-2f3e-4bea-b902-792856a479cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ccbfa2-2f3e-4bea-b902-792856a479cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1342011345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b9a70c-e65e-40c3-a7cc-b29c15626126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936b5cf4d8d44a50aedbafe476964902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:21Z,use_quota=True,user_id='12494f73a17b4922871c7b8782090c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b132257c-041e-4eef-be51-24dcd9b0fd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b132257c-041e-4eef-be51-24dcd9b0fd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbc081c-5976-4b73-b755-6317640caef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbc081c-5976-4b73-b755-6317640caef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b9a70c-e65e-40c3-a7cc-b29c15626126', 'volume_name': 'volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade82d4f-a6ec-446f-9000-638973a0350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade82d4f-a6ec-446f-9000-638973a0350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c399564-7034-470a-962f-658b1911e6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Volume f4b9a70c-e65e-40c3-a7cc-b29c15626126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126', 'volume_size': 1} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1342011345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b9a70c-e65e-40c3-a7cc-b29c15626126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936b5cf4d8d44a50aedbafe476964902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:21Z,use_quota=True,user_id='12494f73a17b4922871c7b8782090c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Creating volume f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:21 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:21 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 1073741824 Jul 15 18:44:21 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:21 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 1073741824" returned: 0 in 0.424s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:21 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 Jul 15 18:44:21 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:21 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126" returned: 0 in 0.251s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c399564-7034-470a-962f-658b1911e6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6472265c-e89b-4930-a26c-f8796c2091d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Volume volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 (f4b9a70c-e65e-40c3-a7cc-b29c15626126): created successfully Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6472265c-e89b-4930-a26c-f8796c2091d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Flow 'volume_create_manager' (3f0c9da2-7913-4b50-bd25-3ee359c3e00c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:21 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bc4105bd-188a-4660-8014-5b9b31bffe04 tempest-VolumesSnapshotTestJSON-17309257 None] Created volume successfully. Jul 15 18:44:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Creating offline snapshot 6539c320-51a7-4d74-8d15-55176f834a35 of volume f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:44:22 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54689d8-caae-4de5-abde-3c58e28b3d06]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:22 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 Jul 15 18:44:22 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:22 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126" returned: 0 in 0.388s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:22 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 1G Jul 15 18:44:22 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:23 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 1G" returned: 0 in 0.463s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:23 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 Jul 15 18:44:23 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:23 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35" returned: 0 in 0.291s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:23 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 is being set with open permissions: ugo+rw Jul 15 18:44:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:23 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 Jul 15 18:44:23 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:23 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35" returned: 0 in 0.236s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:23 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.info Jul 15 18:44:23 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:23 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.info" returned: 0 in 0.253s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:23 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.info is being set with open permissions: ugo+rw Jul 15 18:44:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:23 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.info Jul 15 18:44:23 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:24 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.info" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:24 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6e7c9004-f385-4178-a9ae-fccdbf0caf99 tempest-VolumesSnapshotTestJSON-17309257 None] Create snapshot completed successfully Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Flow 'volume_create_manager' (1a94fb4f-0a28-492b-a5d4-ee1cae09cbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ad7891-6939-4ce5-9a3e-5b62ac86fee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ad7891-6939-4ce5-9a3e-5b62ac86fee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1323988047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936b5cf4d8d44a50aedbafe476964902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6539c320-51a7-4d74-8d15-55176f834a35,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:25Z,use_quota=True,user_id='12494f73a17b4922871c7b8782090c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecdb33b-207b-4346-b7e5-9f79eb2fc040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecdb33b-207b-4346-b7e5-9f79eb2fc040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62562a77-51d8-477c-b63e-46970c1008d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62562a77-51d8-477c-b63e-46970c1008d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02', 'volume_name': 'volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02', 'volume_size': 2, 'snapshot_id': '6539c320-51a7-4d74-8d15-55176f834a35'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd9b5b8-1561-4f12-b660-aa554137aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd9b5b8-1561-4f12-b660-aa554137aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8d6f02-a394-4248-aa93-1dc4b60826f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:24 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Volume 89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02', 'volume_size': 2, 'snapshot_id': '6539c320-51a7-4d74-8d15-55176f834a35'} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-6539c320-51a7-4d74-8d15-55176f834a35-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" by "_create_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-6539c320-51a7-4d74-8d15-55176f834a35-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Creating volume 89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 from snapshot 6539c320-51a7-4d74-8d15-55176f834a35 {{(pid=87863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] snapshot: 6539c320-51a7-4d74-8d15-55176f834a35, volume: 89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fc1e13-db83-47f2-b464-219935b30af1]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:25 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 Jul 15 18:44:25 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:25 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35" returned: 0 in 0.362s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02b13bf-2669-488d-a3b6-d85124dbd721]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:25 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 Jul 15 18:44:25 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:25 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126" returned: 0 in 0.375s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:44:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:25 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 Jul 15 18:44:25 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:30 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" returned: 0 in 4.969s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:30 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6adfa5-db4e-463a-8039-6e7e27e08b29]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:30 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 Jul 15 18:44:30 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:31 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126" returned: 0 in 0.551s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:44:31 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Converted 1024.00 MB image at 206.02 MB/s Jul 15 18:44:31 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 is being set with open permissions: ugo+rw Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:31 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 Jul 15 18:44:31 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:31 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" returned: 0 in 0.261s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" released by "_copy_volume_from_snapshot" :: held 6.632s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-6539c320-51a7-4d74-8d15-55176f834a35-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" released by "_create_volume_from_snapshot" :: held 6.667s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.682s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8d6f02-a394-4248-aa93-1dc4b60826f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02', 'volume_size': 2, 'snapshot_id': '6539c320-51a7-4d74-8d15-55176f834a35'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112794e4-be79-42c0-812c-b5e32bf04b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:31 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Volume volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 (89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02): created successfully Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112794e4-be79-42c0-812c-b5e32bf04b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Flow 'volume_create_manager' (1a94fb4f-0a28-492b-a5d4-ee1cae09cbe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1b792057-396d-4a2a-ab0c-704ebb04ac4c tempest-VolumesSnapshotTestJSON-17309257 None] Created volume successfully. Jul 15 18:44:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:32 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0618c14-8029-4fae-be98-00fe98cdcf5f]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:33 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 Jul 15 18:44:33 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:33 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" returned: 0 in 0.375s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:33 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02 Jul 15 18:44:33 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:33 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" returned: 0 in 0.254s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02" released by "delete_volume" :: held 0.668s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Created reservations ['11609652-b55b-4b69-849f-9f94631eba04', '1c9cad18-c0dd-4733-b65e-72dc087f693f', '7a732994-0c7e-4499-9e2c-17a75ae88841', 'd890480b-db03-4855-8a2e-46564efb8be5'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:33 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:44:33 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:33 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.275s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Deleted volume successfully. Jul 15 18:44:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-17614ebb-71b7-4f4a-be6f-d5f8eb418092 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-89a9bbb4-793e-4e7e-a3bf-eb041f1cfa02-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-6539c320-51a7-4d74-8d15-55176f834a35-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-6539c320-51a7-4d74-8d15-55176f834a35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-f4b9a70c-e65e-40c3-a7cc-b29c15626126" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-f4b9a70c-e65e-40c3-a7cc-b29c15626126" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-6539c320-51a7-4d74-8d15-55176f834a35" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-6539c320-51a7-4d74-8d15-55176f834a35" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Deleting offline snapshot 6539c320-51a7-4d74-8d15-55176f834a35 of volume f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] snapshot_file for this snap is: volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a10bae-82c3-4bd9-b8fd-70e519c36798]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:34 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 Jul 15 18:44:34 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:34 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35" returned: 0 in 0.408s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3721fa-c130-48c1-a012-4288e854e09a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:34 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 Jul 15 18:44:34 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:34 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126" returned: 0 in 0.401s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:34 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 Jul 15 18:44:35 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:35 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:44:35 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:35 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35" returned: 0 in 0.377s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:35 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35 Jul 15 18:44:35 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:35 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.253s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:44:35 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126.6539c320-51a7-4d74-8d15-55176f834a35" returned: 0 in 0.257s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-6539c320-51a7-4d74-8d15-55176f834a35" released by "_delete_snapshot" :: held 1.549s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-f4b9a70c-e65e-40c3-a7cc-b29c15626126" released by "delete_snapshot" :: held 1.575s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Created reservations ['8db4e18e-1fc5-442b-97bc-d578aabe6f7d', '0548fc2e-639e-411e-891a-027c37d9ab97', 'a386a2b2-fc0c-41f7-a2b0-dde8af5a5d2b', '16c22885-db83-4a3f-9d09-e1e2b12a25b7'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:35 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Delete snapshot completed successfully. Jul 15 18:44:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69fb9dec-33ce-4867-aa2d-714896860d2e tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-6539c320-51a7-4d74-8d15-55176f834a35-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-f4b9a70c-e65e-40c3-a7cc-b29c15626126-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-f4b9a70c-e65e-40c3-a7cc-b29c15626126-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-f4b9a70c-e65e-40c3-a7cc-b29c15626126" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-f4b9a70c-e65e-40c3-a7cc-b29c15626126" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5898029-828f-4b78-b482-b139c36feb93]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:36 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 Jul 15 18:44:36 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:36 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126" returned: 0 in 0.359s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:36 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126 Jul 15 18:44:36 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:36 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4b9a70c-e65e-40c3-a7cc-b29c15626126" returned: 0 in 0.242s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-f4b9a70c-e65e-40c3-a7cc-b29c15626126" released by "delete_volume" :: held 0.654s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Created reservations ['0b4df360-902c-487a-b4da-42a3a478be1d', '1058b410-4113-4b16-9d9b-a7b284f0722a', 'da3b4679-fbeb-4576-aae5-eca5551391e5', 'e5e5f787-4c6d-4511-8f82-0bbb038a363a'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:37 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:44:37 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:37 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.241s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Deleted volume successfully. Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b681ea0f-3b5e-41b7-b984-dcbf1bb982fa tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-f4b9a70c-e65e-40c3-a7cc-b29c15626126-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Flow 'volume_create_manager' (fe5128af-1fce-4d06-aaee-7651e95fb0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb7b88e-d393-4b91-9da6-4fbf059cffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb7b88e-d393-4b91-9da6-4fbf059cffc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1892383818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1097b7e0-da6d-48d8-b3d6-f0e71d912795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936b5cf4d8d44a50aedbafe476964902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:38Z,use_quota=True,user_id='12494f73a17b4922871c7b8782090c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69495e35-9f4e-4fa9-ac19-4131f7bc0e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69495e35-9f4e-4fa9-ac19-4131f7bc0e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86a1d90-55db-46ba-bb60-861b06793a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86a1d90-55db-46ba-bb60-861b06793a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1097b7e0-da6d-48d8-b3d6-f0e71d912795', 'volume_name': 'volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d11f003-1aba-4ae0-b913-09686b9b5c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d11f003-1aba-4ae0-b913-09686b9b5c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476b1fc9-f29d-483a-a915-c93dbb5fdde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:37 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Volume 1097b7e0-da6d-48d8-b3d6-f0e71d912795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795', 'volume_size': 1} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1892383818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1097b7e0-da6d-48d8-b3d6-f0e71d912795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936b5cf4d8d44a50aedbafe476964902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:38Z,use_quota=True,user_id='12494f73a17b4922871c7b8782090c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Creating volume 1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:37 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:44:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:38 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 1073741824 Jul 15 18:44:38 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:38 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 1073741824" returned: 0 in 0.392s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:38 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 Jul 15 18:44:38 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:38 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795" returned: 0 in 0.230s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:44:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476b1fc9-f29d-483a-a915-c93dbb5fdde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d7e3d8e-ee6c-45f3-ad43-71eccd2bc8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:38 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Volume volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 (1097b7e0-da6d-48d8-b3d6-f0e71d912795): created successfully Jul 15 18:44:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d7e3d8e-ee6c-45f3-ad43-71eccd2bc8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Flow 'volume_create_manager' (fe5128af-1fce-4d06-aaee-7651e95fb0e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2160339a-5145-4a1e-b8d8-739ed073e1d4 tempest-VolumesSnapshotTestJSON-17309257 None] Created volume successfully. Jul 15 18:44:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Creating offline snapshot 07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b of volume 1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:44:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[253441d2-0c6d-40f0-9647-41b499e27e0b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:39 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 Jul 15 18:44:39 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:39 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795" returned: 0 in 0.347s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:39 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b 1G Jul 15 18:44:39 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:39 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b 1G" returned: 0 in 0.381s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:39 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b Jul 15 18:44:39 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:40 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b" returned: 0 in 0.287s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:40 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b is being set with open permissions: ugo+rw Jul 15 18:44:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:40 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b Jul 15 18:44:40 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:40 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b" returned: 0 in 0.233s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:40 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.info Jul 15 18:44:40 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:40 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.info" returned: 0 in 0.249s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:40 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.info is being set with open permissions: ugo+rw Jul 15 18:44:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:40 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.info Jul 15 18:44:40 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:40 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.info" returned: 0 in 0.238s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:40 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-0f3c0dda-c07c-48f9-a8e6-5301178f36a3 tempest-VolumesSnapshotTestJSON-17309257 None] Create snapshot completed successfully Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Flow 'volume_create_manager' (b7e32fcb-7393-4cc3-8e36-fd79aacc1c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3335c2-d8fc-44d1-920a-7011e7dd6870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3335c2-d8fc-44d1-920a-7011e7dd6870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-252864915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6fc1638-118a-4981-946a-6591a6804633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936b5cf4d8d44a50aedbafe476964902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:42Z,use_quota=True,user_id='12494f73a17b4922871c7b8782090c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4907caf2-6902-474f-947a-4c769fe5037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4907caf2-6902-474f-947a-4c769fe5037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14587717-4d0e-401d-8b4f-7f126b0bf778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14587717-4d0e-401d-8b4f-7f126b0bf778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6fc1638-118a-4981-946a-6591a6804633', 'volume_name': 'volume-e6fc1638-118a-4981-946a-6591a6804633', 'volume_size': 1, 'snapshot_id': '07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c90aa87-bda9-4cad-9a08-369c814f083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c90aa87-bda9-4cad-9a08-369c814f083a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ace126-481f-4d3f-8efe-d010547f08b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:41 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Volume e6fc1638-118a-4981-946a-6591a6804633: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6fc1638-118a-4981-946a-6591a6804633', 'volume_size': 1, 'snapshot_id': '07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b'} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b-e6fc1638-118a-4981-946a-6591a6804633" by "_create_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b-e6fc1638-118a-4981-946a-6591a6804633" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Creating volume e6fc1638-118a-4981-946a-6591a6804633 from snapshot 07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b {{(pid=87863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-e6fc1638-118a-4981-946a-6591a6804633" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-e6fc1638-118a-4981-946a-6591a6804633" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] snapshot: 07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b, volume: e6fc1638-118a-4981-946a-6591a6804633, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[37087409-9205-4382-87a4-3c6a3e79b967]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:42 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b Jul 15 18:44:42 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:42 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b" returned: 0 in 0.384s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:44:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:44:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:44:42 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[782849b5-31fa-4515-b2d4-4346248ed66d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:42 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 Jul 15 18:44:42 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:42 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795" returned: 0 in 0.384s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:42 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:44:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:42 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 Jul 15 18:44:42 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:47 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633" returned: 0 in 4.954s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:47 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d161dfe-eb3b-481f-b4e3-7967d5fce109]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:47 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 Jul 15 18:44:47 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:48 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795" returned: 0 in 0.616s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:44:48 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Converted 1024.00 MB image at 206.67 MB/s Jul 15 18:44:48 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 is being set with open permissions: ugo+rw Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:48 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 Jul 15 18:44:48 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:48 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633" returned: 0 in 0.312s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-e6fc1638-118a-4981-946a-6591a6804633" released by "_copy_volume_from_snapshot" :: held 6.757s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b-e6fc1638-118a-4981-946a-6591a6804633" released by "_create_volume_from_snapshot" :: held 6.788s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.804s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ace126-481f-4d3f-8efe-d010547f08b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6fc1638-118a-4981-946a-6591a6804633', 'volume_size': 1, 'snapshot_id': '07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8bb72f-2652-40e2-8713-1bca387e2a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:48 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Volume volume-e6fc1638-118a-4981-946a-6591a6804633 (e6fc1638-118a-4981-946a-6591a6804633): created successfully Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8bb72f-2652-40e2-8713-1bca387e2a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Flow 'volume_create_manager' (b7e32fcb-7393-4cc3-8e36-fd79aacc1c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ec48b769-db90-413a-b3d4-5fb8674538c5 tempest-VolumesSnapshotTestJSON-17309257 None] Created volume successfully. Jul 15 18:44:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-c8ae3ea2-f8a6-4d36-8020-41fc69ab6afb req-348aa496-febc-4c4e-8983-bb8928f35eeb tempest-TestMinimumBasicScenario-426376066 None] Terminate volume connection completed successfully. Jul 15 18:44:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-c8ae3ea2-f8a6-4d36-8020-41fc69ab6afb req-348aa496-febc-4c4e-8983-bb8928f35eeb tempest-TestMinimumBasicScenario-426376066 None] Deleting attachment 05c78355-7c56-415b-b7e0-5dbc6ae49b32. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Acquiring lock "cinder-f95951b4-5896-4ad3-9e3a-51061ad129c3-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Lock "cinder-f95951b4-5896-4ad3-9e3a-51061ad129c3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Acquiring lock "cinder-quobyte-f95951b4-5896-4ad3-9e3a-51061ad129c3" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-e6fc1638-118a-4981-946a-6591a6804633-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-e6fc1638-118a-4981-946a-6591a6804633-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Lock "cinder-quobyte-f95951b4-5896-4ad3-9e3a-51061ad129c3" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3477e11b-b517-4822-a9e8-f0b2ec2caf74]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-e6fc1638-118a-4981-946a-6591a6804633" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-e6fc1638-118a-4981-946a-6591a6804633" acquired by "delete_volume" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[03575d22-427a-4e33-a927-fae03d0f310e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:49 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 Jul 15 18:44:49 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:49 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 Jul 15 18:44:49 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:50 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3" returned: 0 in 0.400s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:50 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3 Jul 15 18:44:50 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:50 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633" returned: 0 in 0.400s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:50 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633 Jul 15 18:44:50 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:50 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f95951b4-5896-4ad3-9e3a-51061ad129c3" returned: 0 in 0.298s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Lock "cinder-quobyte-f95951b4-5896-4ad3-9e3a-51061ad129c3" released by "delete_volume" :: held 0.744s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:50 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e6fc1638-118a-4981-946a-6591a6804633" returned: 0 in 0.296s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-e6fc1638-118a-4981-946a-6591a6804633" released by "delete_volume" :: held 0.750s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Created reservations ['c5b437b4-36cf-4bf0-b15f-36138877daa8', '35c21d50-f576-4dec-9324-09f93541fc1e', 'fe06b4b8-8d21-4f57-a2ed-325d5d2af264', '6ccf904a-b076-4f56-8ab0-b7e425430f93'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:50 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:44:50 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Created reservations ['63282111-7758-4aec-b21a-393192202816', '0a660e37-6607-438a-9bb2-e8972dddf8d3', '363fbb6b-94c6-4297-9277-e9f024be36d0', '79128561-610c-4e36-a654-9e2324d28901'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:50 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:44:50 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:50 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.295s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Deleted volume successfully. Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2ff69dd5-e695-4ac7-8892-bb8011676f22 tempest-TestMinimumBasicScenario-426376066 None] Lock "cinder-f95951b4-5896-4ad3-9e3a-51061ad129c3-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-1097b7e0-da6d-48d8-b3d6-f0e71d912795" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-1097b7e0-da6d-48d8-b3d6-f0e71d912795" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:51 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.340s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Deleting offline snapshot 07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b of volume 1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] snapshot_file for this snap is: volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:44:51 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Deleted volume successfully. Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[afec2f32-95dd-4f19-b90e-c30b3a515883]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da939a28-34a7-4d8a-acca-b13218b7272a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-e6fc1638-118a-4981-946a-6591a6804633-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:51 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b Jul 15 18:44:51 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:51 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b" returned: 0 in 0.500s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddbe7e5-b100-4dd3-b5bb-27adcd1c3f24]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:51 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 Jul 15 18:44:51 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:52 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795" returned: 0 in 0.457s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:52 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b Jul 15 18:44:52 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:52 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b" returned: 0 in 0.421s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:52 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b Jul 15 18:44:52 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:52 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795.07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b" released by "_delete_snapshot" :: held 1.783s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-1097b7e0-da6d-48d8-b3d6-f0e71d912795" released by "delete_snapshot" :: held 1.832s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:52 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Created reservations ['7fdffdaa-a29b-4925-9a0e-d0944f54f02b', '0aed683a-75d5-460a-af0d-ae6f46d41fe3', '449ef932-ba48-4ab4-91ad-a2272a0cb116', 'b2c4d8a0-41d0-4432-91a7-596953dd9135'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:52 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Delete snapshot completed successfully. Jul 15 18:44:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e035dc93-3303-46cc-88a1-0ec95797963a tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-07bbec0e-8ba2-48f8-8e0d-c99d4aa4243b-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-1097b7e0-da6d-48d8-b3d6-f0e71d912795-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-1097b7e0-da6d-48d8-b3d6-f0e71d912795-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-1097b7e0-da6d-48d8-b3d6-f0e71d912795" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-1097b7e0-da6d-48d8-b3d6-f0e71d912795" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:53 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[442b9bc4-eb5d-40f7-80e0-5eb7d0a87c8c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:53 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 Jul 15 18:44:53 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:53 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795" returned: 0 in 0.378s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:53 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795 Jul 15 18:44:53 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:53 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1097b7e0-da6d-48d8-b3d6-f0e71d912795" returned: 0 in 0.270s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-1097b7e0-da6d-48d8-b3d6-f0e71d912795" released by "delete_volume" :: held 0.708s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Created reservations ['7e991dcd-42e4-4498-baa3-570be893bf18', 'bc81ba9e-6cc8-4c5a-a9ec-5250fa6cb277', '237cee34-d26b-48cd-ad47-a809f71d5042', '4def9765-70b2-49e6-8820-e05f4da52719'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:54 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:44:54 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:54 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.262s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Deleted volume successfully. Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f61bdbec-7f36-4185-a6b3-04f6331dedd7 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-1097b7e0-da6d-48d8-b3d6-f0e71d912795-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-4e6ea452-a1c2-497d-a8cb-ba34953c6890-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-4e6ea452-a1c2-497d-a8cb-ba34953c6890-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "cinder-quobyte-4e6ea452-a1c2-497d-a8cb-ba34953c6890" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-4e6ea452-a1c2-497d-a8cb-ba34953c6890" acquired by "delete_volume" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeaa288-6976-42db-8918-9ea3cfed8e49]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:54 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 Jul 15 18:44:54 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:54 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890" returned: 0 in 0.369s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:54 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890 Jul 15 18:44:54 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:55 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4e6ea452-a1c2-497d-a8cb-ba34953c6890" returned: 0 in 0.268s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-quobyte-4e6ea452-a1c2-497d-a8cb-ba34953c6890" released by "delete_volume" :: held 0.714s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Created reservations ['ea67f68e-f781-478a-aca1-70586975b6c6', '1fd43404-acf0-47b8-a316-aac596cbc034', 'f0d053c7-4a23-4922-be47-60060605c5ab', '0086c467-bc15-4ad7-8302-ed0d64624e13'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:55 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:44:55 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:55 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.265s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:55 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Deleted volume successfully. Jul 15 18:44:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-471b32db-3747-49a7-8d1f-ef2af81c2ae6 tempest-VolumesSnapshotTestJSON-17309257 None] Lock "cinder-4e6ea452-a1c2-497d-a8cb-ba34953c6890-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Flow 'volume_create_manager' (1f76395a-e224-4f2c-8ff5-40668ff79445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513196aa-914f-4021-95cf-bcfe26015d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513196aa-914f-4021-95cf-bcfe26015d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-286239513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031147f5-6d13-4a00-919e-699603ba826f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94265e002bb4c43a0af7e0bd58aa313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:05Z,use_quota=True,user_id='37ca23d462444ce7abe297b2496dfc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd52421-9c28-470b-8080-4e8f1eba8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd52421-9c28-470b-8080-4e8f1eba8191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff9cae1-3d6b-4a93-87f1-6b34e0722c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff9cae1-3d6b-4a93-87f1-6b34e0722c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '031147f5-6d13-4a00-919e-699603ba826f', 'volume_name': 'volume-031147f5-6d13-4a00-919e-699603ba826f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9b1426-5273-486d-8846-b3fd2730ff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9b1426-5273-486d-8846-b3fd2730ff7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486bc479-303d-4434-8cb8-3a479ab84b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:05 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Volume 031147f5-6d13-4a00-919e-699603ba826f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-031147f5-6d13-4a00-919e-699603ba826f', 'volume_size': 1} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-286239513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031147f5-6d13-4a00-919e-699603ba826f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94265e002bb4c43a0af7e0bd58aa313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:05Z,use_quota=True,user_id='37ca23d462444ce7abe297b2496dfc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Creating volume 031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:05 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:05 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f 1073741824 Jul 15 18:45:05 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:05 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f 1073741824" returned: 0 in 0.422s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:05 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f Jul 15 18:45:05 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:05 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f" returned: 0 in 0.237s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486bc479-303d-4434-8cb8-3a479ab84b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-031147f5-6d13-4a00-919e-699603ba826f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1e3183-8f34-4310-9853-70aefff118ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:05 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Volume volume-031147f5-6d13-4a00-919e-699603ba826f (031147f5-6d13-4a00-919e-699603ba826f): created successfully Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1e3183-8f34-4310-9853-70aefff118ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Flow 'volume_create_manager' (1f76395a-e224-4f2c-8ff5-40668ff79445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:05 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1fc34119-a542-43b0-abd2-187bfc2051e5 tempest-VolumeDependencyTests-1206825263 None] Created volume successfully. Jul 15 18:45:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Creating offline snapshot b91fd119-7452-41be-aa9d-8b8730a9813b of volume 031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:45:06 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c637ea-99a7-498d-b1ad-a0442a6dc33e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:06 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f Jul 15 18:45:06 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:06 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f" returned: 0 in 0.378s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:06 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b 1G Jul 15 18:45:06 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:07 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b 1G" returned: 0 in 0.419s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031147f5-6d13-4a00-919e-699603ba826f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:07 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031147f5-6d13-4a00-919e-699603ba826f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b Jul 15 18:45:07 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:07 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-031147f5-6d13-4a00-919e-699603ba826f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b" returned: 0 in 0.302s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:07 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b is being set with open permissions: ugo+rw Jul 15 18:45:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:07 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b Jul 15 18:45:07 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:07 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b" returned: 0 in 0.278s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:07 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.info Jul 15 18:45:07 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:08 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.info" returned: 0 in 0.254s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:08 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.info is being set with open permissions: ugo+rw Jul 15 18:45:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:08 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.info Jul 15 18:45:08 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:08 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.info" returned: 0 in 0.293s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:08 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a9679517-eff4-416a-bd73-3848ce697d34 tempest-VolumeDependencyTests-1206825263 None] Create snapshot completed successfully Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Flow 'volume_create_manager' (c97950a2-2c8e-403d-98cc-653395f366ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3956fc4e-0759-4ca9-b6d1-afd571d5a1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3956fc4e-0759-4ca9-b6d1-afd571d5a1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-246272397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac79a7d8-de06-4077-b891-c8db7e6b7928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94265e002bb4c43a0af7e0bd58aa313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b91fd119-7452-41be-aa9d-8b8730a9813b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:10Z,use_quota=True,user_id='37ca23d462444ce7abe297b2496dfc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae06651-41a5-4816-b117-a40a4f44a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae06651-41a5-4816-b117-a40a4f44a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4402da2c-cea8-4bac-9644-254d2a8c1896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4402da2c-cea8-4bac-9644-254d2a8c1896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac79a7d8-de06-4077-b891-c8db7e6b7928', 'volume_name': 'volume-ac79a7d8-de06-4077-b891-c8db7e6b7928', 'volume_size': 1, 'snapshot_id': 'b91fd119-7452-41be-aa9d-8b8730a9813b'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22540ebf-a595-4797-86df-40fff963cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22540ebf-a595-4797-86df-40fff963cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cfd598-5d5e-49fe-945d-447f6a94bfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:10 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Volume ac79a7d8-de06-4077-b891-c8db7e6b7928: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac79a7d8-de06-4077-b891-c8db7e6b7928', 'volume_size': 1, 'snapshot_id': 'b91fd119-7452-41be-aa9d-8b8730a9813b'} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=70,cinder:UPDATE=90,cinder:INSERT=25,cinder:DELETE=10 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "cinder-quobyte-b91fd119-7452-41be-aa9d-8b8730a9813b-ac79a7d8-de06-4077-b891-c8db7e6b7928" by "_create_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-b91fd119-7452-41be-aa9d-8b8730a9813b-ac79a7d8-de06-4077-b891-c8db7e6b7928" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Creating volume ac79a7d8-de06-4077-b891-c8db7e6b7928 from snapshot b91fd119-7452-41be-aa9d-8b8730a9813b {{(pid=87863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "cinder-quobyte-ac79a7d8-de06-4077-b891-c8db7e6b7928" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-ac79a7d8-de06-4077-b891-c8db7e6b7928" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] snapshot: b91fd119-7452-41be-aa9d-8b8730a9813b, volume: ac79a7d8-de06-4077-b891-c8db7e6b7928, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9553f092-14dd-4908-8977-598db4161fd4]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:10 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b Jul 15 18:45:10 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:10 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b" returned: 0 in 0.409s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031147f5-6d13-4a00-919e-699603ba826f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1ebac1-da31-49cb-9060-4c0c5d5aa921]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:10 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f Jul 15 18:45:10 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:11 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f" returned: 0 in 0.422s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:11 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:45:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:11 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 Jul 15 18:45:11 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:16 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928" returned: 0 in 4.899s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[132b59d6-67c8-4f1e-ba88-2157b97e2f01]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:16 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f Jul 15 18:45:16 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:16 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f" returned: 0 in 0.587s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:45:16 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Converted 1024.00 MB image at 208.94 MB/s Jul 15 18:45:16 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 is being set with open permissions: ugo+rw Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:16 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 Jul 15 18:45:16 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:16 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-ac79a7d8-de06-4077-b891-c8db7e6b7928" released by "_copy_volume_from_snapshot" :: held 6.698s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-b91fd119-7452-41be-aa9d-8b8730a9813b-ac79a7d8-de06-4077-b891-c8db7e6b7928" released by "_create_volume_from_snapshot" :: held 6.731s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.754s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=87,cinder:SELECT=95,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cfd598-5d5e-49fe-945d-447f6a94bfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac79a7d8-de06-4077-b891-c8db7e6b7928', 'volume_size': 1, 'snapshot_id': 'b91fd119-7452-41be-aa9d-8b8730a9813b'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6fc5eb-1b9e-4a85-bfb7-caa4549d5713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:17 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Volume volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 (ac79a7d8-de06-4077-b891-c8db7e6b7928): created successfully Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6fc5eb-1b9e-4a85-bfb7-caa4549d5713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Flow 'volume_create_manager' (c97950a2-2c8e-403d-98cc-653395f366ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:17 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7be7d156-94ec-4c64-b7e9-d9c4baf150d7 tempest-VolumeDependencyTests-1206825263 None] Created volume successfully. Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "cinder-b91fd119-7452-41be-aa9d-8b8730a9813b-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-b91fd119-7452-41be-aa9d-8b8730a9813b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "cinder-quobyte-031147f5-6d13-4a00-919e-699603ba826f" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-031147f5-6d13-4a00-919e-699603ba826f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "cinder-quobyte-b91fd119-7452-41be-aa9d-8b8730a9813b" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-b91fd119-7452-41be-aa9d-8b8730a9813b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Deleting offline snapshot b91fd119-7452-41be-aa9d-8b8730a9813b of volume 031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] snapshot_file for this snap is: volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd5f1f1-b7c8-41dc-90a1-caf633e6698d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:18 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b Jul 15 18:45:18 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:18 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b" returned: 0 in 0.386s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-031147f5-6d13-4a00-919e-699603ba826f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:45:18 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[461f23e4-b400-459e-a2a9-3c48a91b71f0]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:18 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f Jul 15 18:45:18 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:18 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f" returned: 0 in 0.374s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:18 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b Jul 15 18:45:18 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:19 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b" returned: 0 in 0.480s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:19 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b Jul 15 18:45:19 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:19 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f.b91fd119-7452-41be-aa9d-8b8730a9813b" returned: 0 in 0.280s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-b91fd119-7452-41be-aa9d-8b8730a9813b" released by "_delete_snapshot" :: held 1.629s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-031147f5-6d13-4a00-919e-699603ba826f" released by "delete_snapshot" :: held 1.654s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:19 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Created reservations ['73652eeb-5705-426d-b587-2510c468c8b1', '5d02533b-ec2e-49f2-af90-3f90733b9d0e', '07e2a18a-7575-43e0-80c8-76f3c35cffcd', 'f749aa87-10b2-4ec0-92b4-aaa94ad3bc22'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:19 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Delete snapshot completed successfully. Jul 15 18:45:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-449e1e01-56c7-4991-8b1a-83420f05ac55 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-b91fd119-7452-41be-aa9d-8b8730a9813b-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "cinder-031147f5-6d13-4a00-919e-699603ba826f-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-031147f5-6d13-4a00-919e-699603ba826f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "cinder-quobyte-031147f5-6d13-4a00-919e-699603ba826f" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-031147f5-6d13-4a00-919e-699603ba826f" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cbb0a2-1ce6-4095-864f-aad62e6e9577]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:20 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f Jul 15 18:45:20 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:20 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f" returned: 0 in 0.361s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:20 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f Jul 15 18:45:20 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:20 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-031147f5-6d13-4a00-919e-699603ba826f" returned: 0 in 0.262s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-031147f5-6d13-4a00-919e-699603ba826f" released by "delete_volume" :: held 0.680s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Created reservations ['5f934113-76a9-4492-996e-b4bb1ce9e3de', 'ad490a93-40ba-436d-ba4a-656a030903a5', 'add669a2-402d-4c91-965f-69bb5423085d', 'e123db29-85b0-47c5-a4f7-643503a4fd2a'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:20 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:45:20 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:21 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.261s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:21 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Deleted volume successfully. Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-58d9ecb5-4f45-4d6e-a79f-ef21aac7480e tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-031147f5-6d13-4a00-919e-699603ba826f-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "cinder-ac79a7d8-de06-4077-b891-c8db7e6b7928-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-ac79a7d8-de06-4077-b891-c8db7e6b7928-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "cinder-quobyte-ac79a7d8-de06-4077-b891-c8db7e6b7928" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-ac79a7d8-de06-4077-b891-c8db7e6b7928" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce02f9-266e-455d-ba53-0a7fa769157b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:21 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 Jul 15 18:45:21 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:21 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928" returned: 0 in 0.442s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:21 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928 Jul 15 18:45:21 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:22 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ac79a7d8-de06-4077-b891-c8db7e6b7928" returned: 0 in 0.265s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-quobyte-ac79a7d8-de06-4077-b891-c8db7e6b7928" released by "delete_volume" :: held 0.757s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Created reservations ['13b4e45d-978d-4774-8eb0-139757eef3f6', 'bdfe9529-4032-49eb-bf2d-acab27924e81', '543ef33a-521f-48ff-830b-180995d31b93', '87f5cfbf-ced3-4985-b470-34cf4ac5f059'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:22 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:45:22 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:22 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.277s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:22 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Deleted volume successfully. Jul 15 18:45:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-557559d3-a0e5-49da-8747-3e6ed2f20e23 tempest-VolumeDependencyTests-1206825263 None] Lock "cinder-ac79a7d8-de06-4077-b891-c8db7e6b7928-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Flow 'volume_create_manager' (e9f565a7-fc53-4ed5-8a32-9f7ac4d7a3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f803e5-30fa-4af0-9409-ec3453eb2615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f803e5-30fa-4af0-9409-ec3453eb2615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26c85f7-c4f5-4a44-8792-c6b19a7e12fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fce9414e12c432794aafa7af753238c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:26Z,use_quota=True,user_id='6dbe7c56e1214be09b81c456d3f9268c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1924fa0d-2939-4d81-9a45-dad4ebc83142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1924fa0d-2939-4d81-9a45-dad4ebc83142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12936d5e-facd-44fb-a92f-2761d7dc9eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12936d5e-facd-44fb-a92f-2761d7dc9eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26c85f7-c4f5-4a44-8792-c6b19a7e12fc', 'volume_name': 'volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e88845b-ac0e-40af-87ce-dae894794816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e88845b-ac0e-40af-87ce-dae894794816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425f8f6c-1622-4206-9eeb-339c07af69d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:26 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Volume d26c85f7-c4f5-4a44-8792-c6b19a7e12fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc', 'volume_size': 1} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26c85f7-c4f5-4a44-8792-c6b19a7e12fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fce9414e12c432794aafa7af753238c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:26Z,use_quota=True,user_id='6dbe7c56e1214be09b81c456d3f9268c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Creating volume d26c85f7-c4f5-4a44-8792-c6b19a7e12fc {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:26 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:45:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:26 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc 1073741824 Jul 15 18:45:26 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:27 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc 1073741824" returned: 0 in 0.486s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:27 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc Jul 15 18:45:27 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:27 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc" returned: 0 in 0.282s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425f8f6c-1622-4206-9eeb-339c07af69d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d4b58f-5b50-4964-b4d4-5cbec67d90a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:27 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Volume volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc (d26c85f7-c4f5-4a44-8792-c6b19a7e12fc): created successfully Jul 15 18:45:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d4b58f-5b50-4964-b4d4-5cbec67d90a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Flow 'volume_create_manager' (e9f565a7-fc53-4ed5-8a32-9f7ac4d7a3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e8afd645-e3c9-41c2-9989-49d27a903ede tempest-CinderUnicodeTest-949939027 None] Created volume successfully. Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Flow 'volume_create_manager' (5024ca99-f45c-4acc-b80b-7ee9154fbaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc752a9-e288-4038-9d35-49e3b9564b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc752a9-e288-4038-9d35-49e3b9564b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1816580310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54ff0f3-1f11-4819-8c85-f0be50385594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0112608c0ddb40a99588cadba9f24d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:28Z,use_quota=True,user_id='83e95fdddd334e498967c630e8cf132d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e457e19b-7a66-4556-b8fe-bb1d756c6a7d),volume_type_id=e457e19b-7a66-4556-b8fe-bb1d756c6a7d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fa8b90-5786-4e14-a443-3a0af8dfbd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fa8b90-5786-4e14-a443-3a0af8dfbd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8e331b-567d-4ff5-b014-96a72159d620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8e331b-567d-4ff5-b014-96a72159d620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54ff0f3-1f11-4819-8c85-f0be50385594', 'volume_name': 'volume-c54ff0f3-1f11-4819-8c85-f0be50385594', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7df646f-6b23-49dd-9221-19c8374a4645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7df646f-6b23-49dd-9221-19c8374a4645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e0fc05-ec38-49c3-af81-d3ef5c7ead37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:28 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Volume c54ff0f3-1f11-4819-8c85-f0be50385594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54ff0f3-1f11-4819-8c85-f0be50385594', 'volume_size': 1} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1816580310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54ff0f3-1f11-4819-8c85-f0be50385594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0112608c0ddb40a99588cadba9f24d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:28Z,use_quota=True,user_id='83e95fdddd334e498967c630e8cf132d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e457e19b-7a66-4556-b8fe-bb1d756c6a7d),volume_type_id=e457e19b-7a66-4556-b8fe-bb1d756c6a7d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Creating volume c54ff0f3-1f11-4819-8c85-f0be50385594 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:28 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:28 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 1073741824 Jul 15 18:45:28 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Flow 'volume_create_manager' (f4c3b5f4-dee8-4f92-b36d-01cd737abc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:28 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac88a103-e144-47ed-8a7e-eb7c46d8b488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac88a103-e144-47ed-8a7e-eb7c46d8b488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-20925994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124ee34a-8777-40b6-b3cb-ac110827a424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0112608c0ddb40a99588cadba9f24d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:29Z,use_quota=True,user_id='83e95fdddd334e498967c630e8cf132d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f24d98-7d0f-4f5d-ac37-d6ec95db281d),volume_type_id=20f24d98-7d0f-4f5d-ac37-d6ec95db281d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9becce9f-9824-40aa-9431-80aedab3546d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9becce9f-9824-40aa-9431-80aedab3546d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216fe91a-3a00-43df-809f-166599b64f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216fe91a-3a00-43df-809f-166599b64f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '124ee34a-8777-40b6-b3cb-ac110827a424', 'volume_name': 'volume-124ee34a-8777-40b6-b3cb-ac110827a424', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8f90e3-db84-40ba-b81a-54833eccf103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8f90e3-db84-40ba-b81a-54833eccf103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e28b10-71fc-44cc-a757-67b872aca505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Volume 124ee34a-8777-40b6-b3cb-ac110827a424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-124ee34a-8777-40b6-b3cb-ac110827a424', 'volume_size': 1} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:29 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 1073741824" returned: 0 in 0.544s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:29 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 Jul 15 18:45:29 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Flow 'volume_create_manager' (4ce732f4-a3a9-4ebe-8ebc-bc25ee71142b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2968f9dd-9879-4f59-a39e-e297c08ebf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2968f9dd-9879-4f59-a39e-e297c08ebf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-152619936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f29f8e0-ed03-4f69-9f27-15bdfd5dda65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fce9414e12c432794aafa7af753238c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:29Z,use_quota=True,user_id='6dbe7c56e1214be09b81c456d3f9268c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a907cf0-8f0a-4468-807a-30189ce28d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a907cf0-8f0a-4468-807a-30189ce28d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3f8bce-86be-4fa8-aa93-b188beb77834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3f8bce-86be-4fa8-aa93-b188beb77834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f29f8e0-ed03-4f69-9f27-15bdfd5dda65', 'volume_name': 'volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c7c638-68de-4845-94c2-8e892f418cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c7c638-68de-4845-94c2-8e892f418cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fa4c96-174e-46dc-909e-149d80542743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Volume 5f29f8e0-ed03-4f69-9f27-15bdfd5dda65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65', 'volume_size': 1} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:29 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594" returned: 0 in 0.285s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-20925994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124ee34a-8777-40b6-b3cb-ac110827a424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0112608c0ddb40a99588cadba9f24d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:29Z,use_quota=True,user_id='83e95fdddd334e498967c630e8cf132d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f24d98-7d0f-4f5d-ac37-d6ec95db281d),volume_type_id=20f24d98-7d0f-4f5d-ac37-d6ec95db281d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Creating volume 124ee34a-8777-40b6-b3cb-ac110827a424 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:29 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e0fc05-ec38-49c3-af81-d3ef5c7ead37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54ff0f3-1f11-4819-8c85-f0be50385594', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 1073741824 Jul 15 18:45:29 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ccd56d-8a5b-4887-a480-24498aa9f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Volume volume-c54ff0f3-1f11-4819-8c85-f0be50385594 (c54ff0f3-1f11-4819-8c85-f0be50385594): created successfully Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ccd56d-8a5b-4887-a480-24498aa9f15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Flow 'volume_create_manager' (5024ca99-f45c-4acc-b80b-7ee9154fbaaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:29 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-38af0834-e1cd-495c-bcd8-734fb3b471b4 tempest-TestInstancesWithCinderVolumes-1288842915 None] Created volume successfully. Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Flow 'volume_create_manager' (3104fa5e-52da-4725-ad3e-cbd084813b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7aa44d5-3335-461c-9372-d2a00a0fd9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7aa44d5-3335-461c-9372-d2a00a0fd9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-874732747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a26913-570f-432a-bc4c-299ba13d70f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0112608c0ddb40a99588cadba9f24d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:30Z,use_quota=True,user_id='83e95fdddd334e498967c630e8cf132d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b28d7a88-df38-4404-81e2-ec99b10ec51c),volume_type_id=b28d7a88-df38-4404-81e2-ec99b10ec51c)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5569cb0b-579c-4423-86da-c9298399486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5569cb0b-579c-4423-86da-c9298399486c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33eb0175-d401-4374-8115-9270f5eed97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG cinder.image.glance [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Creating Keystone auth plugin from conf {{(pid=87863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 1073741824" returned: 0 in 0.475s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:30 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 Jul 15 18:45:30 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:30 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-152619936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f29f8e0-ed03-4f69-9f27-15bdfd5dda65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fce9414e12c432794aafa7af753238c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:29Z,use_quota=True,user_id='6dbe7c56e1214be09b81c456d3f9268c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Creating volume 5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:30 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e28b10-71fc-44cc-a757-67b872aca505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-124ee34a-8777-40b6-b3cb-ac110827a424', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:30 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 1073741824 Jul 15 18:45:30 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f61ed1c-722c-4139-92e7-7e009a93289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:30 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Volume volume-124ee34a-8777-40b6-b3cb-ac110827a424 (124ee34a-8777-40b6-b3cb-ac110827a424): created successfully Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f61ed1c-722c-4139-92e7-7e009a93289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Flow 'volume_create_manager' (f4c3b5f4-dee8-4f92-b36d-01cd737abc40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33eb0175-d401-4374-8115-9270f5eed97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74a26913-570f-432a-bc4c-299ba13d70f7', 'volume_name': 'volume-74a26913-570f-432a-bc4c-299ba13d70f7', 'volume_size': 1, 'image_id': 'bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1866814622', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0112608c0ddb40a99588cadba9f24d0c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'created_at': datetime.datetime(2026, 7, 15, 16, 45, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 45, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0/file', 'properties': {}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e3489c-fa75-47f7-9507-26c52d2141cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e3489c-fa75-47f7-9507-26c52d2141cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b02464d-9b48-49b7-9177-024cdb597f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:30 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Volume 74a26913-570f-432a-bc4c-299ba13d70f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74a26913-570f-432a-bc4c-299ba13d70f7', 'volume_size': 1, 'image_id': 'bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1866814622', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0112608c0ddb40a99588cadba9f24d0c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'created_at': datetime.datetime(2026, 7, 15, 16, 45, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 45, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0/file', 'properties': {}}, 'image_service': } Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Trying to clone 74a26913-570f-432a-bc4c-299ba13d70f7 from image bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'metadata': {}}]). {{(pid=87863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:45:30 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-34c06b40-e30d-42e3-9c38-36a29392bf91 tempest-TestInstancesWithCinderVolumes-1288842915 None] Created volume successfully. Jul 15 18:45:30 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 1073741824" returned: 0 in 0.459s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:30 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 Jul 15 18:45:30 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:31 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" returned: 0 in 0.260s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fa4c96-174e-46dc-909e-149d80542743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2705c80c-d36b-4c31-a48c-fbb7f26ee980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:31 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Volume volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 (5f29f8e0-ed03-4f69-9f27-15bdfd5dda65): created successfully Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2705c80c-d36b-4c31-a48c-fbb7f26ee980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Flow 'volume_create_manager' (4ce732f4-a3a9-4ebe-8ebc-bc25ee71142b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-48310a5d-19c7-42f6-87be-6d10d47b9360 tempest-CinderUnicodeTest-949939027 None] Created volume successfully. Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Creating offline snapshot d4e4147c-8775-4839-89c9-7e52de312539 of volume 5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dee609-0a16-4c80-ade1-5ee9c11ae348]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:31 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 Jul 15 18:45:31 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:32 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" returned: 0 in 0.407s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:32 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 1G Jul 15 18:45:32 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:32 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 1G" returned: 0 in 0.446s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:32 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 Jul 15 18:45:32 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:32 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539" returned: 0 in 0.309s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:32 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 is being set with open permissions: ugo+rw Jul 15 18:45:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:32 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 Jul 15 18:45:32 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:33 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539" returned: 0 in 0.238s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:33 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.info Jul 15 18:45:33 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:33 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.info" returned: 0 in 0.257s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:33 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.info is being set with open permissions: ugo+rw Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:33 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.info Jul 15 18:45:33 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:33 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.info" returned: 0 in 0.239s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b3f8c6af-8aa5-419f-8013-bbe7ecf51320 tempest-CinderUnicodeTest-949939027 None] Create snapshot completed successfully Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Acquiring lock "cinder-d4e4147c-8775-4839-89c9-7e52de312539-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Lock "cinder-d4e4147c-8775-4839-89c9-7e52de312539-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Acquiring lock "cinder-quobyte-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Lock "cinder-quobyte-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Acquiring lock "cinder-quobyte-d4e4147c-8775-4839-89c9-7e52de312539" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Lock "cinder-quobyte-d4e4147c-8775-4839-89c9-7e52de312539" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Deleting offline snapshot d4e4147c-8775-4839-89c9-7e52de312539 of volume 5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] snapshot_file for this snap is: volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9523fc68-f80c-451f-82e1-85971a3aac21]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD, size 20.69 MB, duration 3.50 sec {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:45:33 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Image download 20.69 MB at 5.92 MB/s Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc8e8a7-d8ae-49b9-a7b2-103b52a5f49e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:33 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 Jul 15 18:45:33 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:34 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD Jul 15 18:45:34 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:34 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539" returned: 0 in 0.372s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[96080eeb-8991-48e7-a3cf-8ae7791662d1]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:34 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Temporary image bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0 is fetched for user 83e95fdddd334e498967c630e8cf132d. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8899b8-a9d1-4e37-b3ad-42cccd711c02]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:34 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 Jul 15 18:45:34 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:34 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD Jul 15 18:45:34 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:34 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" returned: 0 in 0.364s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:34 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 Jul 15 18:45:34 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:34 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-874732747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a26913-570f-432a-bc4c-299ba13d70f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0112608c0ddb40a99588cadba9f24d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:30Z,use_quota=True,user_id='83e95fdddd334e498967c630e8cf132d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b28d7a88-df38-4404-81e2-ec99b10ec51c),volume_type_id=b28d7a88-df38-4404-81e2-ec99b10ec51c)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Creating volume 74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:34 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:34 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 1073741824 Jul 15 18:45:34 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:34 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539" returned: 0 in 0.345s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:34 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539 Jul 15 18:45:34 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:35 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 1073741824" returned: 0 in 0.458s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:35 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 Jul 15 18:45:35 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:35 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:45:35 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:35 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65.d4e4147c-8775-4839-89c9-7e52de312539" returned: 0 in 0.285s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Lock "cinder-quobyte-d4e4147c-8775-4839-89c9-7e52de312539" released by "_delete_snapshot" :: held 1.495s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Lock "cinder-quobyte-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" released by "delete_snapshot" :: held 1.522s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Created reservations ['185d9f28-2531-44aa-9c75-1d616552367b', '7f423e94-ea45-4afc-b2be-26ff0673e468', '8575282c-f150-4af7-9a46-8033d500e07d', '22021d7e-e290-4fae-8080-f1c50a1ab51d'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:35 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Delete snapshot completed successfully. Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d5a033b-e3a1-4435-a005-7568cd72bf6f tempest-CinderUnicodeTest-949939027 None] Lock "cinder-d4e4147c-8775-4839-89c9-7e52de312539-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:35 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7" returned: 0 in 0.264s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Attempting download of bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'metadata': {}}])) to volume 74a26913-570f-432a-bc4c-299ba13d70f7. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:45:35 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.278s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d43c71-bfa1-4c4d-8bbe-4ff9ef3b1f89]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_gwv8rkui {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:35 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_gwv8rkui Jul 15 18:45:35 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:35 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_gwv8rkui" returned: 0 in 0.345s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_gwv8rkui {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Acquiring lock "cinder-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Lock "cinder-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Acquiring lock "cinder-quobyte-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:35 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_gwv8rkui Jul 15 18:45:35 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Lock "cinder-quobyte-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" acquired by "delete_volume" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40195ba-4bb8-4a02-b882-61e94f3b11af]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:36 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 Jul 15 18:45:36 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:36 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_gwv8rkui" returned: 1 in 0.355s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_gwv8rkui' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b4ab4c-a8ca-444c-8475-8c4821f39975]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:36 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD Jul 15 18:45:36 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:36 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" returned: 0 in 0.385s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:36 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65 Jul 15 18:45:36 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:36 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0 was qcow2, converting to raw {{(pid=87863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:36 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 Jul 15 18:45:36 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:36 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" returned: 0 in 0.251s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Lock "cinder-quobyte-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65" released by "delete_volume" :: held 0.689s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Created reservations ['6e2bfb2d-e49e-4940-bc35-5142ffc3d1cc', 'ea628b05-c3d2-4087-9b73-d18eab6a9d25', 'ac42061f-d8cd-4fca-8055-c096df48fe8e', '69ef9461-b8c2-43d4-9cee-1acb51ec7142'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:36 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:45:36 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:37 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.276s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Deleted volume successfully. Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Acquiring lock "cinder-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3f344235-0c60-4b4e-a2fe-a44428cc94a5 tempest-CinderUnicodeTest-949939027 None] Lock "cinder-5f29f8e0-ed03-4f69-9f27-15bdfd5dda65-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Lock "cinder-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Acquiring lock "cinder-quobyte-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Lock "cinder-quobyte-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc" acquired by "delete_volume" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[24463fca-d179-4e8b-b630-3521c3fcdd81]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:37 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc Jul 15 18:45:37 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:37 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc" returned: 0 in 0.397s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:37 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc Jul 15 18:45:37 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:37 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc" returned: 0 in 0.272s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Lock "cinder-quobyte-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc" released by "delete_volume" :: held 0.725s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:37 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Created reservations ['dfbf711f-cac5-4920-852a-81a9a8b84c8e', 'e99907dd-18a0-4a63-9048-fde9185944a7', '55ce59d4-1aa5-49e4-a998-661858b2fb50', 'fb7d6e0f-bca8-434b-9857-c0e85fb56eb2'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:38 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7" returned: 0 in 1.493s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0_lru7eh51devstack@QuobyteHD, size 112.00 MB, duration 1.49 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:45:38 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Converted 112.00 MB image at 74.95 MB/s Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:38 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 1G Jul 15 18:45:38 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:38 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:45:38 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:38 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 1G" returned: 0 in 0.330s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:38 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.281s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Deleted volume successfully. Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a135fe0b-8848-4f97-82dc-ebc36ac24c29]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-27347168-9fd0-4736-89f5-aca12af6e520 tempest-CinderUnicodeTest-949939027 None] Lock "cinder-d26c85f7-c4f5-4a44-8792-c6b19a7e12fc-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:38 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 Jul 15 18:45:38 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:38 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7" returned: 0 in 0.367s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:38 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 Jul 15 18:45:38 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:39 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7" returned: 1 in 0.382s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Downloaded image bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'metadata': {}}])) to volume 74a26913-570f-432a-bc4c-299ba13d70f7 successfully. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Temporary image bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0 for user 83e95fdddd334e498967c630e8cf132d is deleted. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Marking volume 74a26913-570f-432a-bc4c-299ba13d70f7 as bootable. {{(pid=87863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Copying metadata from image bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0 to 74a26913-570f-432a-bc4c-299ba13d70f7. {{(pid=87863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Creating volume glance metadata for volume 74a26913-570f-432a-bc4c-299ba13d70f7 backed by image bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0 with: {'image_id': 'bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'image_name': 'tempest-scenario-img--1866814622', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b02464d-9b48-49b7-9177-024cdb597f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74a26913-570f-432a-bc4c-299ba13d70f7', 'volume_size': 1, 'image_id': 'bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1866814622', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0112608c0ddb40a99588cadba9f24d0c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0', 'created_at': datetime.datetime(2026, 7, 15, 16, 45, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 45, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd1d9f4e-40bc-4e08-aefc-48a37fbc57c0/file', 'properties': {}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eba850-64b8-4cb4-a1af-dd961a90d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:39 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Volume volume-74a26913-570f-432a-bc4c-299ba13d70f7 (74a26913-570f-432a-bc4c-299ba13d70f7): created successfully Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eba850-64b8-4cb4-a1af-dd961a90d09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Flow 'volume_create_manager' (3104fa5e-52da-4725-ad3e-cbd084813b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:39 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e59a24e7-d2dd-4c39-a8da-3c3d16609fa7 tempest-TestInstancesWithCinderVolumes-1288842915 None] Created volume successfully. Jul 15 18:45:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-27b02bcc-bdfd-4d01-9df8-da8b9a47d841 req-bb3abd53-707e-4c72-94b6-7507192b2403 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-27b02bcc-bdfd-4d01-9df8-da8b9a47d841 req-bb3abd53-707e-4c72-94b6-7507192b2403 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:42 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3baec7-5c46-486e-ab37-4f21d3dcb014]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-27b02bcc-bdfd-4d01-9df8-da8b9a47d841 req-bb3abd53-707e-4c72-94b6-7507192b2403 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:42 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 Jul 15 18:45:42 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:42 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-27b02bcc-bdfd-4d01-9df8-da8b9a47d841 req-bb3abd53-707e-4c72-94b6-7507192b2403 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7" returned: 0 in 0.492s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-27b02bcc-bdfd-4d01-9df8-da8b9a47d841 req-bb3abd53-707e-4c72-94b6-7507192b2403 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:43 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 Jul 15 18:45:43 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:43 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-27b02bcc-bdfd-4d01-9df8-da8b9a47d841 req-bb3abd53-707e-4c72-94b6-7507192b2403 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7" returned: 1 in 0.490s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-27b02bcc-bdfd-4d01-9df8-da8b9a47d841 req-bb3abd53-707e-4c72-94b6-7507192b2403 tempest-TestInstancesWithCinderVolumes-1288842915 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-27b02bcc-bdfd-4d01-9df8-da8b9a47d841 req-bb3abd53-707e-4c72-94b6-7507192b2403 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.028s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-27b02bcc-bdfd-4d01-9df8-da8b9a47d841 req-bb3abd53-707e-4c72-94b6-7507192b2403 tempest-TestInstancesWithCinderVolumes-1288842915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-74a26913-570f-432a-bc4c-299ba13d70f7', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd86d437d-18be-4de2-b12a-f2ad6e3c7e01', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:45:43 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-27b02bcc-bdfd-4d01-9df8-da8b9a47d841 req-bb3abd53-707e-4c72-94b6-7507192b2403 tempest-TestInstancesWithCinderVolumes-1288842915 None] attachment_update completed successfully. Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Flow 'volume_create_manager' (5dc52c3f-2481-4b74-b0ad-0d6418212ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6249b2-988d-4121-8ba1-bec7c843f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6249b2-988d-4121-8ba1-bec7c843f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004795236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63929205-cfb7-486e-a21c-b386d003e897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9690659e775645a29fc08186bbe27cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:48Z,use_quota=True,user_id='a15fac32f2fb47ebaa3904e38bd1b771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd196cbf-fd37-4c4f-9d16-aea126c3e155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd196cbf-fd37-4c4f-9d16-aea126c3e155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb155991-a078-4911-85f1-d45f861c7f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb155991-a078-4911-85f1-d45f861c7f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63929205-cfb7-486e-a21c-b386d003e897', 'volume_name': 'volume-63929205-cfb7-486e-a21c-b386d003e897', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03323c36-fa4b-486f-b677-a4621e6bdb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03323c36-fa4b-486f-b677-a4621e6bdb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781bcee7-451d-4a41-98df-acc434710e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:47 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Volume 63929205-cfb7-486e-a21c-b386d003e897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63929205-cfb7-486e-a21c-b386d003e897', 'volume_size': 1} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004795236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63929205-cfb7-486e-a21c-b386d003e897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9690659e775645a29fc08186bbe27cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:48Z,use_quota=True,user_id='a15fac32f2fb47ebaa3904e38bd1b771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Creating volume 63929205-cfb7-486e-a21c-b386d003e897 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:47 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:45:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:47 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897 1073741824 Jul 15 18:45:47 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:48 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897 1073741824" returned: 0 in 0.623s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:48 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897 Jul 15 18:45:48 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:48 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897" returned: 0 in 0.300s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781bcee7-451d-4a41-98df-acc434710e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63929205-cfb7-486e-a21c-b386d003e897', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502a23f9-7f95-48b7-9219-c3d769ff9920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:48 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Volume volume-63929205-cfb7-486e-a21c-b386d003e897 (63929205-cfb7-486e-a21c-b386d003e897): created successfully Jul 15 18:45:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502a23f9-7f95-48b7-9219-c3d769ff9920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Flow 'volume_create_manager' (5dc52c3f-2481-4b74-b0ad-0d6418212ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-21102803-f533-4ec0-bf40-39a365fde3ea tempest-ProjectReaderTests-1506020193 None] Created volume successfully. Jul 15 18:45:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Acquiring lock "cinder-63929205-cfb7-486e-a21c-b386d003e897-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Lock "cinder-63929205-cfb7-486e-a21c-b386d003e897-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Acquiring lock "cinder-quobyte-63929205-cfb7-486e-a21c-b386d003e897" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Lock "cinder-quobyte-63929205-cfb7-486e-a21c-b386d003e897" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:50 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb0e339-3943-4852-ad9a-1aa46823be87]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:50 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897 Jul 15 18:45:50 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:50 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897" returned: 0 in 0.535s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:50 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897 Jul 15 18:45:50 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:51 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-63929205-cfb7-486e-a21c-b386d003e897" returned: 0 in 0.336s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Lock "cinder-quobyte-63929205-cfb7-486e-a21c-b386d003e897" released by "delete_volume" :: held 0.943s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Created reservations ['f7457740-d56e-42a4-a844-1be13d2c626a', '925d50cb-7270-4f78-935a-aa10c8cc0aed', '617c6ff8-c955-439b-91c3-6899c91ec49a', '0417c427-7130-4370-b752-3f35a19ce848'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:51 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:45:51 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:51 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.284s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:51 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Deleted volume successfully. Jul 15 18:45:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-24be7a47-eac5-4b05-8da6-4af9ba71f3c7 tempest-ProjectReaderTests-1506020193 None] Lock "cinder-63929205-cfb7-486e-a21c-b386d003e897-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Flow 'volume_create_manager' (32463727-911b-4aa4-a06c-71f6e563f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a06308-5e1f-46b6-a41b-abb761813e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a06308-5e1f-46b6-a41b-abb761813e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466387577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082fb988-30b3-4160-afff-1c84e0a1b48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9690659e775645a29fc08186bbe27cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:53Z,use_quota=True,user_id='a15fac32f2fb47ebaa3904e38bd1b771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63b540e-52cc-4930-9872-83b08f5d705c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63b540e-52cc-4930-9872-83b08f5d705c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248a90b6-df4f-45cb-b5bb-81eb61045b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248a90b6-df4f-45cb-b5bb-81eb61045b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082fb988-30b3-4160-afff-1c84e0a1b48a', 'volume_name': 'volume-082fb988-30b3-4160-afff-1c84e0a1b48a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80e9e94-4cc6-4522-a74f-8c5ab77eff8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80e9e94-4cc6-4522-a74f-8c5ab77eff8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8966c4fe-7093-4b01-8973-a2141379334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:53 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Volume 082fb988-30b3-4160-afff-1c84e0a1b48a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082fb988-30b3-4160-afff-1c84e0a1b48a', 'volume_size': 1} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466387577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082fb988-30b3-4160-afff-1c84e0a1b48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9690659e775645a29fc08186bbe27cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:53Z,use_quota=True,user_id='a15fac32f2fb47ebaa3904e38bd1b771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Creating volume 082fb988-30b3-4160-afff-1c84e0a1b48a {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:53 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:53 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a 1073741824 Jul 15 18:45:53 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:53 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a 1073741824" returned: 0 in 0.607s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:53 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a Jul 15 18:45:53 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:54 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a" returned: 0 in 0.335s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8966c4fe-7093-4b01-8973-a2141379334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082fb988-30b3-4160-afff-1c84e0a1b48a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aac850d-bd98-402e-aff6-c79322a5319d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:54 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Volume volume-082fb988-30b3-4160-afff-1c84e0a1b48a (082fb988-30b3-4160-afff-1c84e0a1b48a): created successfully Jul 15 18:45:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aac850d-bd98-402e-aff6-c79322a5319d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Flow 'volume_create_manager' (32463727-911b-4aa4-a06c-71f6e563f732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f51067d6-0de9-488a-85ca-80b27f313e89 tempest-ProjectReaderTests-1506020193 None] Created volume successfully. Jul 15 18:45:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Acquiring lock "cinder-082fb988-30b3-4160-afff-1c84e0a1b48a-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Lock "cinder-082fb988-30b3-4160-afff-1c84e0a1b48a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Acquiring lock "cinder-quobyte-082fb988-30b3-4160-afff-1c84e0a1b48a" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Lock "cinder-quobyte-082fb988-30b3-4160-afff-1c84e0a1b48a" acquired by "delete_volume" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:55 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb818c15-54ca-4c85-9138-d1407407ccc8]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:55 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a Jul 15 18:45:55 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:55 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a" returned: 0 in 0.373s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:55 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a Jul 15 18:45:55 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:55 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-082fb988-30b3-4160-afff-1c84e0a1b48a" returned: 0 in 0.256s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Lock "cinder-quobyte-082fb988-30b3-4160-afff-1c84e0a1b48a" released by "delete_volume" :: held 0.668s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Created reservations ['b0553f5a-4861-4765-8b22-8cf011048030', 'bd741799-0fec-49a1-b98c-a713d6bce05b', 'ebbb2301-fb85-491f-9674-d274eee15e14', '811c5277-835e-4433-ad89-3dd063b9180d'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:56 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:45:56 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:56 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.281s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:56 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Deleted volume successfully. Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1cf273bd-b532-4a89-a698-ea861a3b6301 tempest-ProjectReaderTests-1506020193 None] Lock "cinder-082fb988-30b3-4160-afff-1c84e0a1b48a-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Flow 'volume_create_manager' (a8c1bc00-1569-4a56-8a37-4cc57b3af8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd208c2-275f-42d3-8879-039c647c638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd208c2-275f-42d3-8879-039c647c638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974096663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3494054-0df5-460a-9a21-3e002817bf0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9690659e775645a29fc08186bbe27cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:57Z,use_quota=True,user_id='a15fac32f2fb47ebaa3904e38bd1b771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d138f1b-207d-4bcb-9629-9656e91e6f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d138f1b-207d-4bcb-9629-9656e91e6f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05815a90-db8c-497f-bbb7-222e235f4ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05815a90-db8c-497f-bbb7-222e235f4ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3494054-0df5-460a-9a21-3e002817bf0a', 'volume_name': 'volume-e3494054-0df5-460a-9a21-3e002817bf0a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72638306-8307-4acc-b633-79bab940edf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72638306-8307-4acc-b633-79bab940edf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cefab8-da01-4645-8399-99ba26b74fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:56 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Volume e3494054-0df5-460a-9a21-3e002817bf0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3494054-0df5-460a-9a21-3e002817bf0a', 'volume_size': 1} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974096663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3494054-0df5-460a-9a21-3e002817bf0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9690659e775645a29fc08186bbe27cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:57Z,use_quota=True,user_id='a15fac32f2fb47ebaa3904e38bd1b771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Creating volume e3494054-0df5-460a-9a21-3e002817bf0a {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:56 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:45:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:56 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a 1073741824 Jul 15 18:45:56 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:57 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a 1073741824" returned: 0 in 0.417s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:57 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a Jul 15 18:45:57 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:57 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a" returned: 0 in 0.251s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cefab8-da01-4645-8399-99ba26b74fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3494054-0df5-460a-9a21-3e002817bf0a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a8373c-fbaa-4755-b63b-d9afa425841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:57 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Volume volume-e3494054-0df5-460a-9a21-3e002817bf0a (e3494054-0df5-460a-9a21-3e002817bf0a): created successfully Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a8373c-fbaa-4755-b63b-d9afa425841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Flow 'volume_create_manager' (a8c1bc00-1569-4a56-8a37-4cc57b3af8d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:57 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6dae092a-25be-4927-b981-86fceb7358de tempest-ProjectReaderTests-1506020193 None] Created volume successfully. Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Acquiring lock "cinder-e3494054-0df5-460a-9a21-3e002817bf0a-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Lock "cinder-e3494054-0df5-460a-9a21-3e002817bf0a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Acquiring lock "cinder-quobyte-e3494054-0df5-460a-9a21-3e002817bf0a" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Lock "cinder-quobyte-e3494054-0df5-460a-9a21-3e002817bf0a" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b474f5-af53-4e39-b85c-5b4eaf3c22b9]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:58 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a Jul 15 18:45:58 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:58 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a" returned: 0 in 0.351s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:58 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a Jul 15 18:45:58 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:58 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e3494054-0df5-460a-9a21-3e002817bf0a" returned: 0 in 0.261s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Lock "cinder-quobyte-e3494054-0df5-460a-9a21-3e002817bf0a" released by "delete_volume" :: held 0.651s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Created reservations ['be926484-6002-4daf-ab32-e69aba843a5f', '7bb24516-50f1-4b4b-9580-afe3e7f0a24d', 'd082a678-65d3-4a88-a524-aadae83bbf70', 'bd737494-3279-45a7-a6cf-5f1db11d06f1'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:58 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:45:58 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:58 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.239s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Deleted volume successfully. Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb26a3ac-d922-40c2-9a6f-ad51370f84fe tempest-ProjectReaderTests-1506020193 None] Lock "cinder-e3494054-0df5-460a-9a21-3e002817bf0a-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Flow 'volume_create_manager' (6a08bbf2-b25f-4cce-b612-6d3794dde241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06c7a2f-f855-47ee-829b-0e1664b53a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06c7a2f-f855-47ee-829b-0e1664b53a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248515218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57835bf-2909-4d8e-af1d-fe29df3d0b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9690659e775645a29fc08186bbe27cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:59Z,use_quota=True,user_id='a15fac32f2fb47ebaa3904e38bd1b771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6613e5bd-bd34-4150-8209-bd9a0ced6621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6613e5bd-bd34-4150-8209-bd9a0ced6621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3135f0be-3c59-4add-a0c4-c89e489b924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3135f0be-3c59-4add-a0c4-c89e489b924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e57835bf-2909-4d8e-af1d-fe29df3d0b4b', 'volume_name': 'volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4fa7cd-58fd-46b5-9c29-a0722c5718ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4fa7cd-58fd-46b5-9c29-a0722c5718ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad02d5e6-3b64-4235-8088-f841c085af4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:59 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Volume e57835bf-2909-4d8e-af1d-fe29df3d0b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b', 'volume_size': 1} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248515218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57835bf-2909-4d8e-af1d-fe29df3d0b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9690659e775645a29fc08186bbe27cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:59Z,use_quota=True,user_id='a15fac32f2fb47ebaa3904e38bd1b771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Creating volume e57835bf-2909-4d8e-af1d-fe29df3d0b4b {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:59 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:45:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:59 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b 1073741824 Jul 15 18:45:59 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:59 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b 1073741824" returned: 0 in 0.407s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:00 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b Jul 15 18:46:00 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:00 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b" returned: 0 in 0.238s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad02d5e6-3b64-4235-8088-f841c085af4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa21438-34dc-46f5-b2dd-32fb721fe65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:00 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Volume volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b (e57835bf-2909-4d8e-af1d-fe29df3d0b4b): created successfully Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa21438-34dc-46f5-b2dd-32fb721fe65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Flow 'volume_create_manager' (6a08bbf2-b25f-4cce-b612-6d3794dde241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-96bb215f-40c8-442b-a36f-bdc68ce6f01a tempest-ProjectReaderTests-1506020193 None] Created volume successfully. Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Acquiring lock "cinder-e57835bf-2909-4d8e-af1d-fe29df3d0b4b-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Lock "cinder-e57835bf-2909-4d8e-af1d-fe29df3d0b4b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Acquiring lock "cinder-quobyte-e57835bf-2909-4d8e-af1d-fe29df3d0b4b" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Lock "cinder-quobyte-e57835bf-2909-4d8e-af1d-fe29df3d0b4b" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21bc18a-6f48-4d9b-b079-c27ae86284be]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:00 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b Jul 15 18:46:00 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:01 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b" returned: 0 in 0.364s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:01 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b Jul 15 18:46:01 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:01 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-e57835bf-2909-4d8e-af1d-fe29df3d0b4b" returned: 0 in 0.241s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Lock "cinder-quobyte-e57835bf-2909-4d8e-af1d-fe29df3d0b4b" released by "delete_volume" :: held 0.652s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Created reservations ['2683bb93-2640-407f-a396-ab5c20acf322', '992408e9-bbb8-43ba-a7a0-4ad83996cb4a', '3d0be7dd-f114-40fd-aaf7-35be9b690ad7', 'cd3e7367-b0d5-415d-ac40-e74e71329bcc'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:01 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:46:01 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:01 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.283s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:01 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Deleted volume successfully. Jul 15 18:46:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f087-cb48-4883-a66d-272769b7249a tempest-ProjectReaderTests-1506020193 None] Lock "cinder-e57835bf-2909-4d8e-af1d-fe29df3d0b4b-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:11 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=87,cinder:INSERT=32,cinder:UPDATE=99,cinder:DELETE=13 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:46:11 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=82,cinder:UPDATE=116,cinder:DELETE=6,cinder:INSERT=27 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:46:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-4d863d88-0ce0-4d7e-b694-501e64cd25b0 req-d46091a0-48ae-465a-8d6d-8450c5b203a5 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-4d863d88-0ce0-4d7e-b694-501e64cd25b0 req-d46091a0-48ae-465a-8d6d-8450c5b203a5 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8178a43-0bb2-4444-9dfb-8337b3eecd5f]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4d863d88-0ce0-4d7e-b694-501e64cd25b0 req-d46091a0-48ae-465a-8d6d-8450c5b203a5 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:14 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 Jul 15 18:46:14 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:14 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-4d863d88-0ce0-4d7e-b694-501e64cd25b0 req-d46091a0-48ae-465a-8d6d-8450c5b203a5 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594" returned: 0 in 0.366s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-4d863d88-0ce0-4d7e-b694-501e64cd25b0 req-d46091a0-48ae-465a-8d6d-8450c5b203a5 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.383s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-4d863d88-0ce0-4d7e-b694-501e64cd25b0 req-d46091a0-48ae-465a-8d6d-8450c5b203a5 tempest-TestInstancesWithCinderVolumes-1288842915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-c54ff0f3-1f11-4819-8c85-f0be50385594', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b76caa9-cb30-44cb-9422-7e99b19fd8cc', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:46:14 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-4d863d88-0ce0-4d7e-b694-501e64cd25b0 req-d46091a0-48ae-465a-8d6d-8450c5b203a5 tempest-TestInstancesWithCinderVolumes-1288842915 None] attachment_update completed successfully. Jul 15 18:46:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-853414d4-b67c-40b5-9b62-efbbc9718f37 req-9fe6587e-97f0-4f10-8b6d-5fa378b4677a tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-853414d4-b67c-40b5-9b62-efbbc9718f37 req-9fe6587e-97f0-4f10-8b6d-5fa378b4677a tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:17 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bac97f-8f7e-4ce4-b7f4-274d58347b05]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-853414d4-b67c-40b5-9b62-efbbc9718f37 req-9fe6587e-97f0-4f10-8b6d-5fa378b4677a tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:18 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 Jul 15 18:46:18 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:18 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-853414d4-b67c-40b5-9b62-efbbc9718f37 req-9fe6587e-97f0-4f10-8b6d-5fa378b4677a tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424" returned: 0 in 0.441s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-853414d4-b67c-40b5-9b62-efbbc9718f37 req-9fe6587e-97f0-4f10-8b6d-5fa378b4677a tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.466s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-853414d4-b67c-40b5-9b62-efbbc9718f37 req-9fe6587e-97f0-4f10-8b6d-5fa378b4677a tempest-TestInstancesWithCinderVolumes-1288842915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-124ee34a-8777-40b6-b3cb-ac110827a424', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e722af61-37ce-4a51-bff2-a7315aaba0e5', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:46:18 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-853414d4-b67c-40b5-9b62-efbbc9718f37 req-9fe6587e-97f0-4f10-8b6d-5fa378b4677a tempest-TestInstancesWithCinderVolumes-1288842915 None] attachment_update completed successfully. Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Flow 'volume_create_manager' (307f23ff-968a-47c0-942f-b5ffe15e82f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c29a86f-1007-4b22-b110-9f7c6fa93fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c29a86f-1007-4b22-b110-9f7c6fa93fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1741705799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a13311-0b31-4975-b281-5ce12f913ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64931a9a22e44bff9493d108fa2f3a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:22Z,use_quota=True,user_id='85c3007039f442bd81aea6073e46b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9853928-36b9-4047-80f2-e8ecc97d5af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9853928-36b9-4047-80f2-e8ecc97d5af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1547f3ca-a5ec-4eb4-9c82-c9377ffea6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1547f3ca-a5ec-4eb4-9c82-c9377ffea6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a13311-0b31-4975-b281-5ce12f913ed7', 'volume_name': 'volume-32a13311-0b31-4975-b281-5ce12f913ed7', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb90892-8d75-4e9e-b39e-82203d120737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb90892-8d75-4e9e-b39e-82203d120737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048d9e5c-e753-46c7-a9a2-ec9484244f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:22 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Volume 32a13311-0b31-4975-b281-5ce12f913ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a13311-0b31-4975-b281-5ce12f913ed7', 'volume_size': 1} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1741705799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a13311-0b31-4975-b281-5ce12f913ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64931a9a22e44bff9493d108fa2f3a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:22Z,use_quota=True,user_id='85c3007039f442bd81aea6073e46b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Creating volume 32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:22 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:22 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 1073741824 Jul 15 18:46:22 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:22 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 1073741824" returned: 0 in 0.433s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:22 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 Jul 15 18:46:22 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:22 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7" returned: 0 in 0.251s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048d9e5c-e753-46c7-a9a2-ec9484244f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a13311-0b31-4975-b281-5ce12f913ed7', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daebbe6a-381c-4d73-a8ea-cbd75c8a89a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:22 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Volume volume-32a13311-0b31-4975-b281-5ce12f913ed7 (32a13311-0b31-4975-b281-5ce12f913ed7): created successfully Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daebbe6a-381c-4d73-a8ea-cbd75c8a89a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Flow 'volume_create_manager' (307f23ff-968a-47c0-942f-b5ffe15e82f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:22 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-05108933-015b-4e6f-99f5-db3b8d9630f6 tempest-SnapshotDependencyTests-464402341 None] Created volume successfully. Jul 15 18:46:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Creating offline snapshot 6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd of volume 32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:46:23 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17880dac-4a78-43b9-900f-a4e90394b2b5]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:23 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 Jul 15 18:46:23 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:23 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7" returned: 0 in 0.367s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:23 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd 1G Jul 15 18:46:23 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:24 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-abec1ac5-99b6-4f4f-a036-69c5c97f55cd req-0de4a527-3fd6-460f-95da-b80de18288a3 tempest-TestInstancesWithCinderVolumes-1288842915 None] Terminate volume connection completed successfully. Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-abec1ac5-99b6-4f4f-a036-69c5c97f55cd req-0de4a527-3fd6-460f-95da-b80de18288a3 tempest-TestInstancesWithCinderVolumes-1288842915 None] Deleting attachment 2b76caa9-cb30-44cb-9422-7e99b19fd8cc. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:46:24 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd 1G" returned: 0 in 0.405s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a13311-0b31-4975-b281-5ce12f913ed7 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:24 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a13311-0b31-4975-b281-5ce12f913ed7 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd Jul 15 18:46:24 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:24 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a13311-0b31-4975-b281-5ce12f913ed7 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd" returned: 0 in 0.276s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:24 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd is being set with open permissions: ugo+rw Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:24 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd Jul 15 18:46:24 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:24 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd" returned: 0 in 0.232s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:24 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.info Jul 15 18:46:24 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "cinder-c54ff0f3-1f11-4819-8c85-f0be50385594-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-c54ff0f3-1f11-4819-8c85-f0be50385594-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:24 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.info" returned: 0 in 0.258s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:24 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.info is being set with open permissions: ugo+rw Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:24 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.info Jul 15 18:46:24 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "cinder-quobyte-c54ff0f3-1f11-4819-8c85-f0be50385594" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-quobyte-c54ff0f3-1f11-4819-8c85-f0be50385594" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fad6ab-635f-48b3-8c5f-3aea6507add2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:25 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 Jul 15 18:46:25 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:25 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.info" returned: 0 in 0.263s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:25 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-07b10b43-a7a2-4039-b65b-650b1cc219ef tempest-SnapshotDependencyTests-464402341 None] Create snapshot completed successfully Jul 15 18:46:25 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594" returned: 0 in 0.391s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:25 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594 Jul 15 18:46:25 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:25 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c54ff0f3-1f11-4819-8c85-f0be50385594" returned: 0 in 0.271s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-quobyte-c54ff0f3-1f11-4819-8c85-f0be50385594" released by "delete_volume" :: held 0.699s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:25 devstack cinder-volume[87863]: WARNING cinder.quota [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-546456544-1225120512 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-546456544-1225120512, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:46:25 devstack cinder-volume[87863]: WARNING cinder.quota [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-546456544-1225120512 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-546456544-1225120512, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Created reservations ['cb62a65b-1008-4329-85d0-cdf0a365a4e1', 'db05ec6a-6d1f-4c4c-84ad-467762a19199', '16f3056a-d75d-4690-bc82-48ae5a4bf2bc', 'ae048f01-e712-4ca0-a2c6-8c9a393c2393'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:25 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:46:25 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:26 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.281s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:26 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Deleted volume successfully. Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5d673e0c-faae-4dbf-92c4-922bd533ae82 tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-c54ff0f3-1f11-4819-8c85-f0be50385594-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Flow 'volume_create_manager' (ef4f8ec2-f21a-4c48-86dd-e090c2d933f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8a836c-ad5f-429b-9e68-9c32e5f968ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8a836c-ad5f-429b-9e68-9c32e5f968ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5051ca4d-0d6c-49be-9e80-6a84e516d5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64931a9a22e44bff9493d108fa2f3a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:26Z,use_quota=True,user_id='85c3007039f442bd81aea6073e46b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae7ea37-73ea-46ff-a6bc-c44b53ac28a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae7ea37-73ea-46ff-a6bc-c44b53ac28a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4718ece6-fbf2-4075-9644-286a5384bbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4718ece6-fbf2-4075-9644-286a5384bbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5051ca4d-0d6c-49be-9e80-6a84e516d5c3', 'volume_name': 'volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3', 'volume_size': 1, 'snapshot_id': '6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1fadae-ea13-4761-b677-e7f03a3a835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1fadae-ea13-4761-b677-e7f03a3a835c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f099b8d9-67de-4099-8faa-006c2eadad83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:26 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Volume 5051ca4d-0d6c-49be-9e80-6a84e516d5c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3', 'volume_size': 1, 'snapshot_id': '6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd'} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "cinder-quobyte-6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" by "_create_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Creating volume 5051ca4d-0d6c-49be-9e80-6a84e516d5c3 from snapshot 6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd {{(pid=87863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "cinder-quobyte-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] snapshot: 6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd, volume: 5051ca4d-0d6c-49be-9e80-6a84e516d5c3, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6bd2a2-714c-4591-9451-5e448d97465b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:26 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd Jul 15 18:46:26 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:26 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd" returned: 0 in 0.380s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32a13311-0b31-4975-b281-5ce12f913ed7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c540692-1613-4816-b52e-844523c531fe]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:26 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 Jul 15 18:46:26 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:27 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7" returned: 0 in 0.392s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:27 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:46:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:27 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 Jul 15 18:46:27 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:29 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-ffa42d95-56bd-4328-9d27-e887a777edcf req-7da026ab-f590-4fa5-810c-ab0c02502c44 tempest-TestInstancesWithCinderVolumes-1288842915 None] Terminate volume connection completed successfully. Jul 15 18:46:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-ffa42d95-56bd-4328-9d27-e887a777edcf req-7da026ab-f590-4fa5-810c-ab0c02502c44 tempest-TestInstancesWithCinderVolumes-1288842915 None] Deleting attachment e722af61-37ce-4a51-bff2-a7315aaba0e5. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:46:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "cinder-124ee34a-8777-40b6-b3cb-ac110827a424-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-124ee34a-8777-40b6-b3cb-ac110827a424-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "cinder-quobyte-124ee34a-8777-40b6-b3cb-ac110827a424" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-quobyte-124ee34a-8777-40b6-b3cb-ac110827a424" acquired by "delete_volume" :: waited 0.036s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:30 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6179d2-089b-47f6-9c95-272a33cf2deb]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:30 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 Jul 15 18:46:30 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:31 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424" returned: 0 in 0.785s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:31 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424 Jul 15 18:46:31 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:31 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-124ee34a-8777-40b6-b3cb-ac110827a424" returned: 0 in 0.549s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-quobyte-124ee34a-8777-40b6-b3cb-ac110827a424" released by "delete_volume" :: held 1.427s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:31 devstack cinder-volume[87863]: WARNING cinder.quota [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295148971-55202562 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295148971-55202562, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:46:31 devstack cinder-volume[87863]: WARNING cinder.quota [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295148971-55202562 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295148971-55202562, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Created reservations ['d5a24674-ff0d-4a1d-a507-89a889633c23', 'dd792058-a95c-469f-b01b-6f30fc23c6cc', '8c623243-3b42-421b-ae7d-5a92de034e34', '5551dc1e-af1b-402b-a58a-13729a99755c'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:31 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:46:31 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:32 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" returned: 0 in 4.954s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:32 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9a0d45-804a-4b2e-8931-f643f3ea8820]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:32 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.315s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:32 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:32 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Deleted volume successfully. Jul 15 18:46:32 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 Jul 15 18:46:32 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7d7db2c0-7b86-4ca2-967c-78febc0adfde tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-124ee34a-8777-40b6-b3cb-ac110827a424-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:32 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7" returned: 0 in 0.633s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:32 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:46:32 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Converted 1024.00 MB image at 206.63 MB/s Jul 15 18:46:32 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 is being set with open permissions: ugo+rw Jul 15 18:46:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:32 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 Jul 15 18:46:32 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:33 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" returned: 0 in 0.284s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" released by "_copy_volume_from_snapshot" :: held 6.742s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" released by "_create_volume_from_snapshot" :: held 6.779s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.797s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f099b8d9-67de-4099-8faa-006c2eadad83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3', 'volume_size': 1, 'snapshot_id': '6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba7c2d6-b842-4095-b63a-29e45403f376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:33 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Volume volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 (5051ca4d-0d6c-49be-9e80-6a84e516d5c3): created successfully Jul 15 18:46:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba7c2d6-b842-4095-b63a-29e45403f376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:33 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Flow 'volume_create_manager' (ef4f8ec2-f21a-4c48-86dd-e090c2d933f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-57e4b11e-971e-4dbb-b628-2be44fa5bb64 tempest-SnapshotDependencyTests-464402341 None] Created volume successfully. Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "cinder-6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "cinder-quobyte-32a13311-0b31-4975-b281-5ce12f913ed7" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-32a13311-0b31-4975-b281-5ce12f913ed7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "cinder-quobyte-6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Deleting offline snapshot 6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd of volume 32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] snapshot_file for this snap is: volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba394a02-dcb3-4868-b8b4-b5954dbf8a5d]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:34 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd Jul 15 18:46:34 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:34 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd" returned: 0 in 0.571s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32a13311-0b31-4975-b281-5ce12f913ed7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1c8b85-ecde-4d42-8fce-cb979a6fdb74]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:34 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 Jul 15 18:46:34 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:35 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7" returned: 0 in 0.420s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:35 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd Jul 15 18:46:35 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:35 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:46:35 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:35 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-dcfb00bc-77ec-4581-b038-0f21efe914ab req-df63f1d4-77a4-4d66-93c4-9a856068aae3 tempest-TestInstancesWithCinderVolumes-1288842915 None] Terminate volume connection completed successfully. Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-dcfb00bc-77ec-4581-b038-0f21efe914ab req-df63f1d4-77a4-4d66-93c4-9a856068aae3 tempest-TestInstancesWithCinderVolumes-1288842915 None] Deleting attachment d86d437d-18be-4de2-b12a-f2ad6e3c7e01. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:46:35 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.352s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:46:35 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd" returned: 0 in 0.438s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:35 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd Jul 15 18:46:35 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:35 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7.6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd" returned: 0 in 0.266s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd" released by "_delete_snapshot" :: held 1.838s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-32a13311-0b31-4975-b281-5ce12f913ed7" released by "delete_snapshot" :: held 1.866s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:35 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Created reservations ['354dd2c0-01a1-46d6-9cc6-d220eccc5bca', '4e379f6b-4207-4c72-905d-67b5579df6dd', '97cd5cce-f7b4-42b0-aadd-867f7a10c941', 'a32edad4-1f0b-485e-ba4b-94c25f3c73b6'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:36 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Delete snapshot completed successfully. Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1681fec5-4b37-400a-acac-63a148d1fe91 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-6eafdcb8-fc0a-47d8-a705-9fce64b0d9bd-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "cinder-32a13311-0b31-4975-b281-5ce12f913ed7-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-32a13311-0b31-4975-b281-5ce12f913ed7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "cinder-quobyte-32a13311-0b31-4975-b281-5ce12f913ed7" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-32a13311-0b31-4975-b281-5ce12f913ed7" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b4961d-2452-440a-977d-f2c0a2e47bf5]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:36 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 Jul 15 18:46:36 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "cinder-74a26913-570f-432a-bc4c-299ba13d70f7-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-74a26913-570f-432a-bc4c-299ba13d70f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "cinder-quobyte-74a26913-570f-432a-bc4c-299ba13d70f7" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-quobyte-74a26913-570f-432a-bc4c-299ba13d70f7" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:36 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7" returned: 0 in 0.387s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[22438c96-1197-4662-9c5a-d6bc1dbce731]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:36 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7 Jul 15 18:46:36 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:36 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 Jul 15 18:46:36 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:36 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-32a13311-0b31-4975-b281-5ce12f913ed7" returned: 0 in 0.264s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-32a13311-0b31-4975-b281-5ce12f913ed7" released by "delete_volume" :: held 0.708s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:36 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Created reservations ['007fce93-90ff-485b-b400-0f48911b0c20', 'bb5bafc4-c3d0-4a75-bbd7-93f0b8b1bcab', '9c7de705-49bd-4f79-8393-61abb73113cc', '82ad3cf4-a75d-48a0-b73e-fb5fda12037b'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:37 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7" returned: 0 in 0.394s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:37 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:46:37 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:37 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 Jul 15 18:46:37 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:37 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Deleted volume successfully. Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "cinder-5051ca4d-0d6c-49be-9e80-6a84e516d5c3-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c213dae0-cd32-47ef-b6ef-811641cd9f28 tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-32a13311-0b31-4975-b281-5ce12f913ed7-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-5051ca4d-0d6c-49be-9e80-6a84e516d5c3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "cinder-quobyte-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" acquired by "delete_volume" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5452da7b-4260-4d73-b262-0a903566641e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:37 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7" returned: 1 in 0.387s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:37 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7 Jul 15 18:46:37 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:37 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 Jul 15 18:46:37 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:37 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-74a26913-570f-432a-bc4c-299ba13d70f7" returned: 0 in 0.264s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-quobyte-74a26913-570f-432a-bc4c-299ba13d70f7" released by "delete_volume" :: held 1.121s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:37 devstack cinder-volume[87863]: WARNING cinder.quota [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1614616840-2003150819 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1614616840-2003150819, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:46:37 devstack cinder-volume[87863]: WARNING cinder.quota [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1614616840-2003150819 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1614616840-2003150819, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Created reservations ['aadcbfa5-bf1f-46c3-a792-615969e26a63', 'a6317d49-c32e-4108-8c82-4c8402f6e879', '48d10465-c600-4794-bf48-d14979d309da', '702f299a-1d58-44fa-a13c-6ba4912b9a6e'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:37 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" returned: 0 in 0.358s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:37 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3 Jul 15 18:46:37 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:37 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:46:37 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:38 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" returned: 0 in 0.246s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-quobyte-5051ca4d-0d6c-49be-9e80-6a84e516d5c3" released by "delete_volume" :: held 0.647s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Created reservations ['40d8988e-803e-462e-88a4-0c1a2d2ea3de', '37ada4c8-2382-45c8-9338-4acf0b303c05', 'fbaead3a-83ed-4581-b8bb-8877dbd3a7dc', '3342effd-cf41-4aaf-9215-83d11747699b'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:38 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.259s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Deleted volume successfully. Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-86283cd4-b466-42bf-9d9e-edb9d59bfb4e tempest-TestInstancesWithCinderVolumes-1288842915 None] Lock "cinder-74a26913-570f-432a-bc4c-299ba13d70f7-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:38 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:46:38 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:38 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.246s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Deleted volume successfully. Jul 15 18:46:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d519f817-a07d-4046-b535-6a4fc1f5dc4f tempest-SnapshotDependencyTests-464402341 None] Lock "cinder-5051ca4d-0d6c-49be-9e80-6a84e516d5c3-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:48 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=48,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:46:49 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=58,cinder:UPDATE=59,cinder:DELETE=3,cinder:INSERT=14 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:35 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:47:35 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:35 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:47:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Flow 'volume_create_manager' (a33c11ca-be72-4d49-8fee-66f2a193ef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc1c957-14e5-484b-9201-fdf216203f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc1c957-14e5-484b-9201-fdf216203f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-864906440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62442531-f96b-406e-9ad5-30e7d87a1a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81085a8bf3bc48258492b5c194519462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:40Z,use_quota=True,user_id='bdde67114419461e82858c50f4d4ec91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72a83a1-23ba-436c-91f3-005307310b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72a83a1-23ba-436c-91f3-005307310b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c850dbf1-4bac-4ea1-b6cc-54d979c7a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c850dbf1-4bac-4ea1-b6cc-54d979c7a586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62442531-f96b-406e-9ad5-30e7d87a1a7b', 'volume_name': 'volume-62442531-f96b-406e-9ad5-30e7d87a1a7b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e71801-d343-405e-b115-4701fe989456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e71801-d343-405e-b115-4701fe989456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79274a53-d020-4fd4-9327-0f064358d2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:39 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Volume 62442531-f96b-406e-9ad5-30e7d87a1a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62442531-f96b-406e-9ad5-30e7d87a1a7b', 'volume_size': 1} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-864906440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62442531-f96b-406e-9ad5-30e7d87a1a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81085a8bf3bc48258492b5c194519462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:40Z,use_quota=True,user_id='bdde67114419461e82858c50f4d4ec91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Creating volume 62442531-f96b-406e-9ad5-30e7d87a1a7b {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:39 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:47:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:39 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b 1073741824 Jul 15 18:47:39 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:40 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b 1073741824" returned: 0 in 0.397s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:40 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b Jul 15 18:47:40 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:40 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b" returned: 0 in 0.237s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79274a53-d020-4fd4-9327-0f064358d2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62442531-f96b-406e-9ad5-30e7d87a1a7b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e301ef6-aaa9-4c6e-992c-bb0276a10eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Volume volume-62442531-f96b-406e-9ad5-30e7d87a1a7b (62442531-f96b-406e-9ad5-30e7d87a1a7b): created successfully Jul 15 18:47:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e301ef6-aaa9-4c6e-992c-bb0276a10eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:40 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Flow 'volume_create_manager' (a33c11ca-be72-4d49-8fee-66f2a193ef21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:40 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8aa7b2fe-c11e-4210-8bb6-89232d74b51f tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Created volume successfully. Jul 15 18:47:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-cd4e28b1-086c-45e7-a866-e76e73cbc6aa req-d1d5474d-067e-46b9-a636-0b07ae3f9c9b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-cd4e28b1-086c-45e7-a866-e76e73cbc6aa req-d1d5474d-067e-46b9-a636-0b07ae3f9c9b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:41 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[186b9a45-0dac-4480-a459-de961ea78dbe]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-cd4e28b1-086c-45e7-a866-e76e73cbc6aa req-d1d5474d-067e-46b9-a636-0b07ae3f9c9b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:41 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b Jul 15 18:47:41 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:41 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [req-cd4e28b1-086c-45e7-a866-e76e73cbc6aa req-d1d5474d-067e-46b9-a636-0b07ae3f9c9b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b" returned: 0 in 0.344s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [req-cd4e28b1-086c-45e7-a866-e76e73cbc6aa req-d1d5474d-067e-46b9-a636-0b07ae3f9c9b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.359s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-cd4e28b1-086c-45e7-a866-e76e73cbc6aa req-d1d5474d-067e-46b9-a636-0b07ae3f9c9b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c', 'name': 'volume-62442531-f96b-406e-9ad5-30e7d87a1a7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da817b37-a7ca-4011-8630-aa7effebfe2f', 'enforce_multipath': True} {{(pid=87863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:47:41 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-cd4e28b1-086c-45e7-a866-e76e73cbc6aa req-d1d5474d-067e-46b9-a636-0b07ae3f9c9b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] attachment_update completed successfully. Jul 15 18:47:44 devstack cinder-volume[87863]: INFO cinder.volume.manager [req-d0a1860b-53e8-4778-8398-d2b373fc7514 req-ca04b172-673f-4bc4-916b-357f3e83ed80 tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Terminate volume connection completed successfully. Jul 15 18:47:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [req-d0a1860b-53e8-4778-8398-d2b373fc7514 req-ca04b172-673f-4bc4-916b-357f3e83ed80 tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Deleting attachment da817b37-a7ca-4011-8630-aa7effebfe2f. {{(pid=87863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:47:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Acquiring lock "cinder-62442531-f96b-406e-9ad5-30e7d87a1a7b-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "cinder-62442531-f96b-406e-9ad5-30e7d87a1a7b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Acquiring lock "cinder-quobyte-62442531-f96b-406e-9ad5-30e7d87a1a7b" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "cinder-quobyte-62442531-f96b-406e-9ad5-30e7d87a1a7b" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:45 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2e2a22-954c-4d23-9544-bdee0a9f3ac2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:45 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b Jul 15 18:47:45 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:45 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b" returned: 0 in 0.353s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:45 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b Jul 15 18:47:45 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:46 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-62442531-f96b-406e-9ad5-30e7d87a1a7b" returned: 0 in 0.250s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "cinder-quobyte-62442531-f96b-406e-9ad5-30e7d87a1a7b" released by "delete_volume" :: held 0.643s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Created reservations ['beda9382-0c34-49bc-bf2b-4a44f448d237', 'a183fc3b-ec6a-49cb-9349-09a6f5d0d093', '8e013d83-147b-4341-8d87-63678e1b89c1', 'b8542444-72d5-4343-9bc8-4c9c76fd7178'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:46 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:47:46 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:46 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.244s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:46 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Deleted volume successfully. Jul 15 18:47:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-722ec2df-1359-42dd-92f6-3d2c1445b93b tempest-TestServerVolumeAttachScenarioOldVersion-688888069 None] Lock "cinder-62442531-f96b-406e-9ad5-30e7d87a1a7b-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:56 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=17,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:47:56 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=15,cinder:SELECT=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (1ecf6a46-6571-4aae-84e8-6a5f7cb2c32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c240797-93ab-422e-b309-5b3759d3caf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c240797-93ab-422e-b309-5b3759d3caf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406844660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e390804-bd45-42ad-b8b1-0b04627a131e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:59Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cefb6b-ecc5-4002-b4d4-4195aaa45d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cefb6b-ecc5-4002-b4d4-4195aaa45d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80889efa-4247-4f64-b637-6990f536df70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80889efa-4247-4f64-b637-6990f536df70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e390804-bd45-42ad-b8b1-0b04627a131e', 'volume_name': 'volume-8e390804-bd45-42ad-b8b1-0b04627a131e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c1f9da-c68f-41df-8a61-215966693ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c1f9da-c68f-41df-8a61-215966693ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301cf31a-5aeb-4977-996f-3f4907f91368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:59 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume 8e390804-bd45-42ad-b8b1-0b04627a131e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e390804-bd45-42ad-b8b1-0b04627a131e', 'volume_size': 1} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406844660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e390804-bd45-42ad-b8b1-0b04627a131e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:59Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Creating volume 8e390804-bd45-42ad-b8b1-0b04627a131e {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:59 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:59 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e 1073741824 Jul 15 18:47:59 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:59 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e 1073741824" returned: 0 in 0.397s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:59 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e Jul 15 18:47:59 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:00 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e" returned: 0 in 0.229s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301cf31a-5aeb-4977-996f-3f4907f91368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e390804-bd45-42ad-b8b1-0b04627a131e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d259df0c-e487-400b-8a59-171e329eb7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:00 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume volume-8e390804-bd45-42ad-b8b1-0b04627a131e (8e390804-bd45-42ad-b8b1-0b04627a131e): created successfully Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d259df0c-e487-400b-8a59-171e329eb7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (1ecf6a46-6571-4aae-84e8-6a5f7cb2c32e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-07f931de-234e-4858-bedd-ae353a46132a tempest-CreateVolumesFromSnapshotTest-580348632 None] Created volume successfully. Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Creating offline snapshot be9b1ea1-10c7-46f0-9836-2b18f6661655 of volume 8e390804-bd45-42ad-b8b1-0b04627a131e {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c5d322-461f-4e82-b185-826bf856f114]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:00 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e Jul 15 18:48:00 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:00 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e" returned: 0 in 0.341s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:00 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 1G Jul 15 18:48:00 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:01 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 1G" returned: 0 in 0.365s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e390804-bd45-42ad-b8b1-0b04627a131e -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:01 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e390804-bd45-42ad-b8b1-0b04627a131e -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 Jul 15 18:48:01 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:01 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e390804-bd45-42ad-b8b1-0b04627a131e -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655" returned: 0 in 0.268s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:01 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 is being set with open permissions: ugo+rw Jul 15 18:48:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:01 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 Jul 15 18:48:01 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:01 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655" returned: 0 in 0.228s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:01 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.info Jul 15 18:48:01 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:02 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.info" returned: 0 in 0.261s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:02 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.info is being set with open permissions: ugo+rw Jul 15 18:48:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:02 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.info Jul 15 18:48:02 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:02 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.info" returned: 0 in 0.227s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.768s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:02 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-647ad107-c3a6-4c24-84d4-f079d12a06f4 tempest-CreateVolumesFromSnapshotTest-580348632 None] Create snapshot completed successfully Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (c8a00aff-58aa-4e4a-bd25-ba203956d515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489fdf65-1fb9-441e-a9ac-a393da23002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489fdf65-1fb9-441e-a9ac-a393da23002f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-947681371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2add5090-9622-4c9a-ab71-0803a5a8d54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:03Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6aef9a2-eb30-4dd4-9361-ce245baf8a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6aef9a2-eb30-4dd4-9361-ce245baf8a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05ecc94-acb5-4290-a1a0-03a5524d2ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05ecc94-acb5-4290-a1a0-03a5524d2ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2add5090-9622-4c9a-ab71-0803a5a8d54c', 'volume_name': 'volume-2add5090-9622-4c9a-ab71-0803a5a8d54c', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2869e583-120d-415e-8dd8-e79f35dd5c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2869e583-120d-415e-8dd8-e79f35dd5c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82486cc9-2054-4368-8a42-3bf6365e6947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume 2add5090-9622-4c9a-ab71-0803a5a8d54c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2add5090-9622-4c9a-ab71-0803a5a8d54c', 'volume_size': 1} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-947681371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2add5090-9622-4c9a-ab71-0803a5a8d54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:03Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Creating volume 2add5090-9622-4c9a-ab71-0803a5a8d54c {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:03 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:03 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c 1073741824 Jul 15 18:48:03 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (30f0a664-f130-4718-b6e7-6afb1b04ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f837ec-e0b8-429d-9e00-930fa4aa054b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f837ec-e0b8-429d-9e00-930fa4aa054b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1079007169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6fdc5ec-a870-4155-be13-fd5dafcb860e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:03Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5495c60-c083-44bf-b576-a7da89c05f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5495c60-c083-44bf-b576-a7da89c05f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc877bdd-e392-423c-ab7d-930f210f4d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc877bdd-e392-423c-ab7d-930f210f4d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6fdc5ec-a870-4155-be13-fd5dafcb860e', 'volume_name': 'volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e458080-eac0-4964-9cfb-456eb9ad78c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e458080-eac0-4964-9cfb-456eb9ad78c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde23236-aa6f-48f7-a647-bae20b223fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume d6fdc5ec-a870-4155-be13-fd5dafcb860e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e', 'volume_size': 1} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:03 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c 1073741824" returned: 0 in 0.502s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:03 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c Jul 15 18:48:03 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (9379b336-321d-4bb4-a587-6bace995e6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909562f0-d0f8-4a6a-90dd-661784203aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909562f0-d0f8-4a6a-90dd-661784203aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-686408554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2420692e-59aa-484b-96d7-3048b723584b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:04Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ae6bff-b39d-40e3-8b25-ad2711c0dd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ae6bff-b39d-40e3-8b25-ad2711c0dd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c066fd7-2cc6-4894-aca7-5e3314013ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c066fd7-2cc6-4894-aca7-5e3314013ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2420692e-59aa-484b-96d7-3048b723584b', 'volume_name': 'volume-2420692e-59aa-484b-96d7-3048b723584b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76cc936-9df7-4945-9932-a09be9e2afe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76cc936-9df7-4945-9932-a09be9e2afe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2aa2e0-c243-41cc-a7b6-6466cfe32986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume 2420692e-59aa-484b-96d7-3048b723584b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2420692e-59aa-484b-96d7-3048b723584b', 'volume_size': 1} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:03 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c" returned: 0 in 0.265s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1079007169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6fdc5ec-a870-4155-be13-fd5dafcb860e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:03Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Creating volume d6fdc5ec-a870-4155-be13-fd5dafcb860e {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:03 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82486cc9-2054-4368-8a42-3bf6365e6947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2add5090-9622-4c9a-ab71-0803a5a8d54c', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e 1073741824 Jul 15 18:48:03 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b48a74-f2eb-4253-8ab9-4471749f1355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:03 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume volume-2add5090-9622-4c9a-ab71-0803a5a8d54c (2add5090-9622-4c9a-ab71-0803a5a8d54c): created successfully Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b48a74-f2eb-4253-8ab9-4471749f1355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (c8a00aff-58aa-4e4a-bd25-ba203956d515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:04 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-eefe7666-7db2-4a05-916c-961b4d64871b tempest-CreateVolumesFromSnapshotTest-580348632 None] Created volume successfully. Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (ea8a5d4f-5254-4450-a79b-e18aa345ee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc36ff9a-bf08-4053-9c39-5f7b99f792a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc36ff9a-bf08-4053-9c39-5f7b99f792a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794354911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11447042-9248-4900-8960-353f8aa37019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:04Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ea800b-f4fa-4bc3-a558-5d88d6eccf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ea800b-f4fa-4bc3-a558-5d88d6eccf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a8c4a1-aa59-4264-a07b-465543a2342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a8c4a1-aa59-4264-a07b-465543a2342e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11447042-9248-4900-8960-353f8aa37019', 'volume_name': 'volume-11447042-9248-4900-8960-353f8aa37019', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5768118-8d12-4c1a-a36f-0b45a6172bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5768118-8d12-4c1a-a36f-0b45a6172bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5141ff-2e15-418f-a975-3c01bc52ef45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume 11447042-9248-4900-8960-353f8aa37019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11447042-9248-4900-8960-353f8aa37019', 'volume_size': 1} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:04 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e 1073741824" returned: 0 in 0.471s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (b2fe17f0-9323-4a14-b552-7a3aa69aee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d17e5cb-c776-4baa-b2e9-fdfd9a454186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d17e5cb-c776-4baa-b2e9-fdfd9a454186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312933933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d70a1fb-dd31-4b20-a99c-184be4cf1503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:04Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:04 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e Jul 15 18:48:04 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840f141d-0660-4e01-bc2a-e841589f14ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840f141d-0660-4e01-bc2a-e841589f14ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1cc030-5efb-48c0-83dc-5e0b8f44f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1cc030-5efb-48c0-83dc-5e0b8f44f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d70a1fb-dd31-4b20-a99c-184be4cf1503', 'volume_name': 'volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ffee04-d43b-45bf-a46c-aa1caed720c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ffee04-d43b-45bf-a46c-aa1caed720c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191e89df-45dd-4925-9832-7ce5746e8036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume 4d70a1fb-dd31-4b20-a99c-184be4cf1503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503', 'volume_size': 1} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:04 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e" returned: 0 in 0.232s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-686408554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2420692e-59aa-484b-96d7-3048b723584b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:04Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Creating volume 2420692e-59aa-484b-96d7-3048b723584b {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:04 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:04 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b 1073741824 Jul 15 18:48:04 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde23236-aa6f-48f7-a647-bae20b223fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be62ea5-d06e-4b7d-aeb3-1dbde81f40ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:04 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e (d6fdc5ec-a870-4155-be13-fd5dafcb860e): created successfully Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be62ea5-d06e-4b7d-aeb3-1dbde81f40ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (30f0a664-f130-4718-b6e7-6afb1b04ca04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:04 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7aeb8f62-8999-4ac6-b07d-b4f45c5b0530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Created volume successfully. Jul 15 18:48:05 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b 1073741824" returned: 0 in 0.400s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:05 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b Jul 15 18:48:05 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:05 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b" returned: 0 in 0.233s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.230s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794354911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11447042-9248-4900-8960-353f8aa37019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:04Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Creating volume 11447042-9248-4900-8960-353f8aa37019 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:05 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2aa2e0-c243-41cc-a7b6-6466cfe32986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2420692e-59aa-484b-96d7-3048b723584b', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c93050a-2f37-4d73-9517-c6f89117656f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:05 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019 1073741824 Jul 15 18:48:05 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:05 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume volume-2420692e-59aa-484b-96d7-3048b723584b (2420692e-59aa-484b-96d7-3048b723584b): created successfully Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c93050a-2f37-4d73-9517-c6f89117656f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (9379b336-321d-4bb4-a587-6bace995e6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:05 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a3599dba-d55e-44bd-a046-f26cefe97ac5 tempest-CreateVolumesFromSnapshotTest-580348632 None] Created volume successfully. Jul 15 18:48:05 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019 1073741824" returned: 0 in 0.411s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:05 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019 Jul 15 18:48:05 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:06 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019" returned: 0 in 0.233s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312933933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d70a1fb-dd31-4b20-a99c-184be4cf1503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009aef8e059d4f409884f9a83741f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:04Z,use_quota=True,user_id='9dc887938940489faf11a6ab96fb13bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Creating volume 4d70a1fb-dd31-4b20-a99c-184be4cf1503 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:06 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5141ff-2e15-418f-a975-3c01bc52ef45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11447042-9248-4900-8960-353f8aa37019', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:06 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503 1073741824 Jul 15 18:48:06 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e20d418-7f8c-4b11-b7b9-df7bb2a355b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:06 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume volume-11447042-9248-4900-8960-353f8aa37019 (11447042-9248-4900-8960-353f8aa37019): created successfully Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e20d418-7f8c-4b11-b7b9-df7bb2a355b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (ea8a5d4f-5254-4450-a79b-e18aa345ee14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5d6e74c1-9777-43b0-9f2f-23b17186272e tempest-CreateVolumesFromSnapshotTest-580348632 None] Created volume successfully. Jul 15 18:48:06 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503 1073741824" returned: 0 in 0.416s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:06 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503 Jul 15 18:48:06 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:06 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503" returned: 0 in 0.247s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191e89df-45dd-4925-9832-7ce5746e8036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a19c447-8c1b-4f6e-8e3e-45682ed3cb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:06 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Volume volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503 (4d70a1fb-dd31-4b20-a99c-184be4cf1503): created successfully Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a19c447-8c1b-4f6e-8e3e-45682ed3cb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:06 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Flow 'volume_create_manager' (b2fe17f0-9323-4a14-b552-7a3aa69aee72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-30ad4b3b-9de4-4d0c-b4d7-d1125c5e1530 tempest-CreateVolumesFromSnapshotTest-580348632 None] Created volume successfully. Jul 15 18:48:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-4d70a1fb-dd31-4b20-a99c-184be4cf1503-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-4d70a1fb-dd31-4b20-a99c-184be4cf1503-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-quobyte-4d70a1fb-dd31-4b20-a99c-184be4cf1503" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-4d70a1fb-dd31-4b20-a99c-184be4cf1503" acquired by "delete_volume" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d113ec-2ca5-4690-9c26-87471de47993]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:07 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503 Jul 15 18:48:07 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:08 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503" returned: 0 in 0.334s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:08 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503 Jul 15 18:48:08 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:08 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-4d70a1fb-dd31-4b20-a99c-184be4cf1503" returned: 0 in 0.234s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-4d70a1fb-dd31-4b20-a99c-184be4cf1503" released by "delete_volume" :: held 0.604s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Created reservations ['c332357e-61e9-423f-b462-def3b5d30280', '3deb0caf-065c-425f-8a70-a3dca67f4d1d', '0313d39a-2f00-4b4e-8f4e-e32dd947b957', '3651766c-2cfd-44eb-ad12-1a3978004002'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:08 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:08 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:08 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.262s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:08 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Deleted volume successfully. Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-9a8567a7-75e3-4e6e-ada0-2d0ad389b797 tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-4d70a1fb-dd31-4b20-a99c-184be4cf1503-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-11447042-9248-4900-8960-353f8aa37019-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-11447042-9248-4900-8960-353f8aa37019-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-quobyte-11447042-9248-4900-8960-353f8aa37019" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-11447042-9248-4900-8960-353f8aa37019" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4413cb4a-8e95-4da6-bd43-edbb83be8e2f]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:09 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019 Jul 15 18:48:09 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:09 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019" returned: 0 in 0.357s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:09 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019 Jul 15 18:48:09 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:09 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-11447042-9248-4900-8960-353f8aa37019" returned: 0 in 0.241s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-11447042-9248-4900-8960-353f8aa37019" released by "delete_volume" :: held 0.635s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Created reservations ['ab197d54-38b0-4e45-a68f-4956def86f15', '4d712147-2d7c-46fa-8035-eb08c4f4b988', '00ace3ab-d3b2-4d80-bac0-25e68192f95f', '7f0a4dec-dd16-43a4-bf96-313ce12f8e31'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:09 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:09 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:09 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.230s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:09 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:10 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Deleted volume successfully. Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-13e2aef6-f3b6-47e6-94be-e86c6501a7dd tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-11447042-9248-4900-8960-353f8aa37019-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-2420692e-59aa-484b-96d7-3048b723584b-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-2420692e-59aa-484b-96d7-3048b723584b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-quobyte-2420692e-59aa-484b-96d7-3048b723584b" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-2420692e-59aa-484b-96d7-3048b723584b" acquired by "delete_volume" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[def69744-7bb3-4815-8555-6305b826fa37]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:10 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b Jul 15 18:48:10 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:10 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b" returned: 0 in 0.337s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:10 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b Jul 15 18:48:10 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:10 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2420692e-59aa-484b-96d7-3048b723584b" returned: 0 in 0.237s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-2420692e-59aa-484b-96d7-3048b723584b" released by "delete_volume" :: held 0.612s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Created reservations ['101dcfde-0111-4f29-ac09-ac043180e401', '2d70f9f6-f9d4-4730-9ebf-012f371bf596', '7aabcf06-ee9a-4d74-9019-03e5277b3773', '81cd4894-69e0-4d0a-b62b-52a3c199c5cb'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:10 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:10 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:11 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.230s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:11 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Deleted volume successfully. Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5df13b8a-fdae-44b3-91b0-ac80a9dbbb6a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-2420692e-59aa-484b-96d7-3048b723584b-delete_volume" released by "delete_volume" :: held 1.024s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-d6fdc5ec-a870-4155-be13-fd5dafcb860e-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-d6fdc5ec-a870-4155-be13-fd5dafcb860e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-quobyte-d6fdc5ec-a870-4155-be13-fd5dafcb860e" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-d6fdc5ec-a870-4155-be13-fd5dafcb860e" acquired by "delete_volume" :: waited 0.013s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9374815e-6b91-4700-8d14-759ec96a0a01]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:11 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e Jul 15 18:48:11 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:11 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e" returned: 0 in 0.345s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:11 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e Jul 15 18:48:11 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:11 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d6fdc5ec-a870-4155-be13-fd5dafcb860e" returned: 0 in 0.234s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-d6fdc5ec-a870-4155-be13-fd5dafcb860e" released by "delete_volume" :: held 0.615s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:11 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Created reservations ['04efe807-0786-4177-8441-0c5e26dc15bb', 'e58b7fc8-076b-4501-96e2-e4a72502becc', '8b334044-edac-446b-bb52-7e6c1f05d822', '5fa5df86-462d-4cc9-87bf-16e2920ddd80'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:12 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:12 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:12 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.234s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:12 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Deleted volume successfully. Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-52c77ed3-897b-4988-8197-23ae4de9e74a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-d6fdc5ec-a870-4155-be13-fd5dafcb860e-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-2add5090-9622-4c9a-ab71-0803a5a8d54c-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-2add5090-9622-4c9a-ab71-0803a5a8d54c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-quobyte-2add5090-9622-4c9a-ab71-0803a5a8d54c" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-2add5090-9622-4c9a-ab71-0803a5a8d54c" acquired by "delete_volume" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8029a6-5ad3-4c34-909e-b77d6e8ac916]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:12 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c Jul 15 18:48:12 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:12 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c" returned: 0 in 0.356s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:12 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c Jul 15 18:48:12 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:13 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-2add5090-9622-4c9a-ab71-0803a5a8d54c" returned: 0 in 0.237s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-2add5090-9622-4c9a-ab71-0803a5a8d54c" released by "delete_volume" :: held 0.630s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Created reservations ['e4b6dbe6-ce0d-4371-9e02-4cb84d1ad943', '5e8fdccc-12cc-4ce9-b3ad-21aa720989dd', 'b9e304ba-2934-4453-9128-f429cbacf892', '73151bff-4b1f-45b6-a352-19d1d4eaa3aa'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:13 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:13 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:13 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.234s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:13 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Deleted volume successfully. Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a5629a14-1e4e-4f0d-84c6-85dc10ec699b tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-2add5090-9622-4c9a-ab71-0803a5a8d54c-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-be9b1ea1-10c7-46f0-9836-2b18f6661655-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-be9b1ea1-10c7-46f0-9836-2b18f6661655-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-quobyte-8e390804-bd45-42ad-b8b1-0b04627a131e" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-8e390804-bd45-42ad-b8b1-0b04627a131e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-quobyte-be9b1ea1-10c7-46f0-9836-2b18f6661655" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-be9b1ea1-10c7-46f0-9836-2b18f6661655" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Deleting offline snapshot be9b1ea1-10c7-46f0-9836-2b18f6661655 of volume 8e390804-bd45-42ad-b8b1-0b04627a131e {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] snapshot_file for this snap is: volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebfbb61-a282-4e14-b987-e8cba0b41217]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:13 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 Jul 15 18:48:13 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:13 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655" returned: 0 in 0.340s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e390804-bd45-42ad-b8b1-0b04627a131e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53358da-323b-4d3c-a0dc-afc041cdd45b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:14 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e Jul 15 18:48:14 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:14 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e" returned: 0 in 0.333s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:14 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 Jul 15 18:48:14 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:14 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655" returned: 0 in 0.312s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:14 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655 Jul 15 18:48:14 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:14 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e.be9b1ea1-10c7-46f0-9836-2b18f6661655" returned: 0 in 0.246s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-be9b1ea1-10c7-46f0-9836-2b18f6661655" released by "_delete_snapshot" :: held 1.330s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-8e390804-bd45-42ad-b8b1-0b04627a131e" released by "delete_snapshot" :: held 1.351s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:14 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Created reservations ['e0a82643-80c3-47aa-be6a-0ab6f8c95a76', '2f7eb32c-6156-46dd-b607-27148ed83ae5', 'd1e67ef7-b31f-497a-8606-f9e5d3f78711', '6509e46a-1294-41d3-b55b-f67b815da5de'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:15 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Delete snapshot completed successfully. Jul 15 18:48:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0807ff6b-bce0-4cb3-8d12-1ae9e5296b5a tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-be9b1ea1-10c7-46f0-9836-2b18f6661655-delete_snapshot" released by "delete_snapshot" :: held 1.471s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-8e390804-bd45-42ad-b8b1-0b04627a131e-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-8e390804-bd45-42ad-b8b1-0b04627a131e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "cinder-quobyte-8e390804-bd45-42ad-b8b1-0b04627a131e" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-8e390804-bd45-42ad-b8b1-0b04627a131e" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:15 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5815767c-f582-4753-bb48-a11a13a0760e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:15 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e Jul 15 18:48:15 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:16 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e" returned: 0 in 0.338s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:16 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e Jul 15 18:48:16 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:16 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8e390804-bd45-42ad-b8b1-0b04627a131e" returned: 0 in 0.230s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-quobyte-8e390804-bd45-42ad-b8b1-0b04627a131e" released by "delete_volume" :: held 0.629s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Created reservations ['1fc6bdba-8b49-43a9-8b96-281ac97f9933', 'f7dbfea9-6935-47a1-a4bb-2a1c8053e9d8', 'a3b11a55-edc6-4c54-9ffa-92999939961e', 'b62e83dc-f454-48dc-ad04-a5d8c716e23c'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:16 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:16 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:16 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.229s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:16 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Deleted volume successfully. Jul 15 18:48:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8c874829-5bd6-4d5a-9858-5f8be1ac26eb tempest-CreateVolumesFromSnapshotTest-580348632 None] Lock "cinder-8e390804-bd45-42ad-b8b1-0b04627a131e-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (be832ce8-9f66-4a13-a846-c35d2c8f9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0df6610-0a37-487c-b472-41a0b17d48d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0df6610-0a37-487c-b472-41a0b17d48d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922774589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9649486e-0e9f-4f18-97ef-f50085bb0a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:19Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fe63a0-5a76-416e-a009-909a2627afa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fe63a0-5a76-416e-a009-909a2627afa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c624b4-3775-45c5-910b-0fc6483c60f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c624b4-3775-45c5-910b-0fc6483c60f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9649486e-0e9f-4f18-97ef-f50085bb0a61', 'volume_name': 'volume-9649486e-0e9f-4f18-97ef-f50085bb0a61', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d83a04-fd7a-4df2-9c6d-c5f4829eaa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d83a04-fd7a-4df2-9c6d-c5f4829eaa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4ae9e4-fbdb-4115-aa8a-54eb0e843c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:19 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume 9649486e-0e9f-4f18-97ef-f50085bb0a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9649486e-0e9f-4f18-97ef-f50085bb0a61', 'volume_size': 1} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922774589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9649486e-0e9f-4f18-97ef-f50085bb0a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:19Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Creating volume 9649486e-0e9f-4f18-97ef-f50085bb0a61 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:19 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:19 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61 1073741824 Jul 15 18:48:19 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:19 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61 1073741824" returned: 0 in 0.407s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:19 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61 Jul 15 18:48:19 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:20 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61" returned: 0 in 0.234s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4ae9e4-fbdb-4115-aa8a-54eb0e843c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9649486e-0e9f-4f18-97ef-f50085bb0a61', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a014a90-4f57-497a-85ae-89994dfff6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:20 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume volume-9649486e-0e9f-4f18-97ef-f50085bb0a61 (9649486e-0e9f-4f18-97ef-f50085bb0a61): created successfully Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a014a90-4f57-497a-85ae-89994dfff6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (be832ce8-9f66-4a13-a846-c35d2c8f9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-136ab92f-50dc-496e-a367-bb3dc73d02d6 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created volume successfully. Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (24059155-6f43-4032-87ff-9af27648d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fefe908-d749-406a-83e5-34dbda9152cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fefe908-d749-406a-83e5-34dbda9152cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488367916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8475f16-0d88-4efd-9ed6-ebb6521879d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:21Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc4bb92-fe8d-4465-8bd5-d8ef411f8cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc4bb92-fe8d-4465-8bd5-d8ef411f8cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f61423-7af1-4f9b-b2c5-59cc0d2e139c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f61423-7af1-4f9b-b2c5-59cc0d2e139c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8475f16-0d88-4efd-9ed6-ebb6521879d2', 'volume_name': 'volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c491c80-a795-42bb-8421-fbd2544fb514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c491c80-a795-42bb-8421-fbd2544fb514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a6b4ee-deef-4720-8c82-d04bb36fb83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:20 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume a8475f16-0d88-4efd-9ed6-ebb6521879d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2', 'volume_size': 1} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488367916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8475f16-0d88-4efd-9ed6-ebb6521879d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:21Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Creating volume a8475f16-0d88-4efd-9ed6-ebb6521879d2 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:20 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:20 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2 1073741824 Jul 15 18:48:20 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (7bb18375-d2cd-4e4d-9988-62c42669d6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19727e10-9de4-48a0-af8b-d487882321e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19727e10-9de4-48a0-af8b-d487882321e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1051919404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50d1684-26e3-492b-b77c-be96461dc4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:21Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e893416f-f1d9-449c-b690-56bdfa8c3cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e893416f-f1d9-449c-b690-56bdfa8c3cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf022d0-05c6-4abf-979c-c9685dda552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf022d0-05c6-4abf-979c-c9685dda552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50d1684-26e3-492b-b77c-be96461dc4ed', 'volume_name': 'volume-a50d1684-26e3-492b-b77c-be96461dc4ed', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d4704b-5d5d-4368-a732-855ec9a6baf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d4704b-5d5d-4368-a732-855ec9a6baf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af11f7a-6c17-4ae0-b55b-2dc99114e219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume a50d1684-26e3-492b-b77c-be96461dc4ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50d1684-26e3-492b-b77c-be96461dc4ed', 'volume_size': 1} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:21 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2 1073741824" returned: 0 in 0.491s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:21 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2 Jul 15 18:48:21 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (d9e327c0-5703-4a7f-926b-5cffb4e5bad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0671e9c7-93e0-4b3e-ac88-f69dcebd29a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0671e9c7-93e0-4b3e-ac88-f69dcebd29a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864949360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ee2e6c-7671-4a41-9dbe-5eaa2ba03132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:21Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f28098-b8f5-4448-ad1c-93fa1ab00c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f28098-b8f5-4448-ad1c-93fa1ab00c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb15a4fc-6475-46f6-81a8-236fac53aad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb15a4fc-6475-46f6-81a8-236fac53aad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ee2e6c-7671-4a41-9dbe-5eaa2ba03132', 'volume_name': 'volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8896494-88ca-41f1-8572-e116a73bb69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8896494-88ca-41f1-8572-e116a73bb69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00c31c0-f199-407d-aa71-2e559e17921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume 60ee2e6c-7671-4a41-9dbe-5eaa2ba03132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132', 'volume_size': 1} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:21 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2" returned: 0 in 0.258s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1051919404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50d1684-26e3-492b-b77c-be96461dc4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:21Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Creating volume a50d1684-26e3-492b-b77c-be96461dc4ed {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:21 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a6b4ee-deef-4720-8c82-d04bb36fb83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ee643c-79c8-42ea-881f-c5416dcfcc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed 1073741824 Jul 15 18:48:21 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2 (a8475f16-0d88-4efd-9ed6-ebb6521879d2): created successfully Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ee643c-79c8-42ea-881f-c5416dcfcc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (24059155-6f43-4032-87ff-9af27648d10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:21 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a818bd4c-3ce7-410e-abc8-67090e2b5d50 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created volume successfully. Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (40c36172-c397-45e7-b885-036cbf66f5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b2c099-2827-48cb-94d8-7f4b8869f442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b2c099-2827-48cb-94d8-7f4b8869f442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1775031706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c1626a-845a-4a24-824d-d1c1ebabd2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:22Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f201d113-ae90-44f3-876b-72052f97166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f201d113-ae90-44f3-876b-72052f97166f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5657b3fe-3301-45e7-bffa-29d32098be8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5657b3fe-3301-45e7-bffa-29d32098be8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c1626a-845a-4a24-824d-d1c1ebabd2a3', 'volume_name': 'volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98270a7-5615-4dbd-b69d-2459b70c222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98270a7-5615-4dbd-b69d-2459b70c222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2567530d-f1b2-4cb8-a467-a23d7f45414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume f4c1626a-845a-4a24-824d-d1c1ebabd2a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3', 'volume_size': 1} Jul 15 18:48:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:22 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed 1073741824" returned: 0 in 0.487s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:22 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed Jul 15 18:48:22 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (42ccbd5e-5ab8-4965-a6bb-30b131085267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ff763a-9566-42ca-b13e-be9d5c0c0024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ff763a-9566-42ca-b13e-be9d5c0c0024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595533712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f7aa59-79c1-4484-aa18-35cdea51df26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:22Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275c76c8-b5c1-4c86-9184-b9d0783ed2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275c76c8-b5c1-4c86-9184-b9d0783ed2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a190a49-c87b-4001-aac6-e0a9ff679e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a190a49-c87b-4001-aac6-e0a9ff679e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f7aa59-79c1-4484-aa18-35cdea51df26', 'volume_name': 'volume-c8f7aa59-79c1-4484-aa18-35cdea51df26', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc832b8-0b1f-4ede-aa90-c3725369ee00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc832b8-0b1f-4ede-aa90-c3725369ee00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f19447-bd64-48f3-a3fe-6daf76ddfc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:22 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume c8f7aa59-79c1-4484-aa18-35cdea51df26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f7aa59-79c1-4484-aa18-35cdea51df26', 'volume_size': 1} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:22 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed" returned: 0 in 0.242s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864949360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ee2e6c-7671-4a41-9dbe-5eaa2ba03132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:21Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Creating volume 60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:22 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af11f7a-6c17-4ae0-b55b-2dc99114e219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50d1684-26e3-492b-b77c-be96461dc4ed', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:22 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 1073741824 Jul 15 18:48:22 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4078b18-56ed-47cf-98f8-5f0806dc9762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:22 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume volume-a50d1684-26e3-492b-b77c-be96461dc4ed (a50d1684-26e3-492b-b77c-be96461dc4ed): created successfully Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4078b18-56ed-47cf-98f8-5f0806dc9762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (7bb18375-d2cd-4e4d-9988-62c42669d6ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:22 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-445988af-dfda-42f7-a1fd-ed24446738e3 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created volume successfully. Jul 15 18:48:22 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 1073741824" returned: 0 in 0.445s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:22 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 Jul 15 18:48:22 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:23 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132" returned: 0 in 0.237s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1775031706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c1626a-845a-4a24-824d-d1c1ebabd2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:22Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Creating volume f4c1626a-845a-4a24-824d-d1c1ebabd2a3 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:23 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:23 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3 1073741824 Jul 15 18:48:23 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00c31c0-f199-407d-aa71-2e559e17921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c297f42d-aaf3-4e57-9c27-92c012ddcf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:23 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 (60ee2e6c-7671-4a41-9dbe-5eaa2ba03132): created successfully Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c297f42d-aaf3-4e57-9c27-92c012ddcf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (d9e327c0-5703-4a7f-926b-5cffb4e5bad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:23 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-40f5ea70-b782-4837-a48b-b186bf81decb tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created volume successfully. Jul 15 18:48:23 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3 1073741824" returned: 0 in 0.422s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:23 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3 Jul 15 18:48:23 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:23 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3" returned: 0 in 0.239s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.546s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595533712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f7aa59-79c1-4484-aa18-35cdea51df26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca58b85b3d4530a6af454e31f9d623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:22Z,use_quota=True,user_id='74beeb82851449d0ba4fede34cc19eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Creating volume c8f7aa59-79c1-4484-aa18-35cdea51df26 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:23 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2567530d-f1b2-4cb8-a467-a23d7f45414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:23 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26 1073741824 Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb54837-ae2c-44ef-b90f-db9b37892faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:23 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:23 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3 (f4c1626a-845a-4a24-824d-d1c1ebabd2a3): created successfully Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb54837-ae2c-44ef-b90f-db9b37892faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (40c36172-c397-45e7-b885-036cbf66f5ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:23 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5a4d8b9c-46fe-4432-8754-70abedb290fd tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created volume successfully. Jul 15 18:48:24 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26 1073741824" returned: 0 in 0.397s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:24 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26 Jul 15 18:48:24 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:24 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26" returned: 0 in 0.254s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f19447-bd64-48f3-a3fe-6daf76ddfc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f7aa59-79c1-4484-aa18-35cdea51df26', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711c36db-de11-4f29-9849-610d995cb916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:24 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Volume volume-c8f7aa59-79c1-4484-aa18-35cdea51df26 (c8f7aa59-79c1-4484-aa18-35cdea51df26): created successfully Jul 15 18:48:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711c36db-de11-4f29-9849-610d995cb916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Flow 'volume_create_manager' (42ccbd5e-5ab8-4965-a6bb-30b131085267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:24 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-60849527-887d-4a57-9d3f-9d11c20e5928 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created volume successfully. Jul 15 18:48:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-c8f7aa59-79c1-4484-aa18-35cdea51df26-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-c8f7aa59-79c1-4484-aa18-35cdea51df26-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-quobyte-c8f7aa59-79c1-4484-aa18-35cdea51df26" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-c8f7aa59-79c1-4484-aa18-35cdea51df26" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:25 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895b512-6ce9-4484-ad09-6e2d8f311d22]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:25 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26 Jul 15 18:48:25 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:26 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26" returned: 0 in 0.345s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:26 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26 Jul 15 18:48:26 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:26 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8f7aa59-79c1-4484-aa18-35cdea51df26" returned: 0 in 0.232s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-c8f7aa59-79c1-4484-aa18-35cdea51df26" released by "delete_volume" :: held 0.616s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created reservations ['4801f537-8002-4fea-9291-bd5832a497e0', '3b81f438-61ff-494e-8f78-aa3605db3845', '0f6cdac4-7d2f-47d1-b210-c828f8a53df8', '249b3e10-f572-4733-b0d4-f2539233ef5d'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:26 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:26 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:26 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.239s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:26 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Deleted volume successfully. Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4d878b23-3981-4d0d-b187-2296603ba7b5 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-c8f7aa59-79c1-4484-aa18-35cdea51df26-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-f4c1626a-845a-4a24-824d-d1c1ebabd2a3-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-f4c1626a-845a-4a24-824d-d1c1ebabd2a3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-quobyte-f4c1626a-845a-4a24-824d-d1c1ebabd2a3" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-f4c1626a-845a-4a24-824d-d1c1ebabd2a3" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bde838-7e2c-4e79-8e3d-a6d65b795e97]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:27 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3 Jul 15 18:48:27 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:27 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3" returned: 0 in 0.346s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:27 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3 Jul 15 18:48:27 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:27 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f4c1626a-845a-4a24-824d-d1c1ebabd2a3" returned: 0 in 0.250s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-f4c1626a-845a-4a24-824d-d1c1ebabd2a3" released by "delete_volume" :: held 0.631s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created reservations ['d52fa43b-fea7-4c96-bb00-a4a946cc8c01', '8f068723-dc60-4e9d-a87b-389071d91f61', '832bf1ed-59c1-4432-b651-a046f1a08e01', 'f0b10eb4-ecbc-492a-ae33-f042e3c2db2c'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:27 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:27 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:27 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.259s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Deleted volume successfully. Jul 15 18:48:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7518ca51-e9a4-4acc-a4f7-9d71d7b6d698 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-f4c1626a-845a-4a24-824d-d1c1ebabd2a3-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-quobyte-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[654e1435-7dff-4cdc-8f13-2b2a6d800aab]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:28 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 Jul 15 18:48:28 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:28 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132" returned: 0 in 0.353s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:28 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132 Jul 15 18:48:28 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:28 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132" returned: 0 in 0.240s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132" released by "delete_volume" :: held 0.631s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created reservations ['3192e541-bff8-4c62-979c-40531a24d1e5', 'b6c2f57f-be35-4c6e-9e0c-21b4df4e509e', 'd56cb268-2941-488e-98fe-9e13d46c9fdf', 'f77f737d-12e7-4270-9bed-e3122d2eefb9'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:28 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:28 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:29 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.236s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:29 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Deleted volume successfully. Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4c8c281b-199f-45ba-82b0-4cd7b5f01e79 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-60ee2e6c-7671-4a41-9dbe-5eaa2ba03132-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-a50d1684-26e3-492b-b77c-be96461dc4ed-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-a50d1684-26e3-492b-b77c-be96461dc4ed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-quobyte-a50d1684-26e3-492b-b77c-be96461dc4ed" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-a50d1684-26e3-492b-b77c-be96461dc4ed" acquired by "delete_volume" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0ac708-aad0-44d6-9d09-b5c15c829644]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:29 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed Jul 15 18:48:29 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:29 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed" returned: 0 in 0.340s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:29 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed Jul 15 18:48:29 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:29 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a50d1684-26e3-492b-b77c-be96461dc4ed" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-a50d1684-26e3-492b-b77c-be96461dc4ed" released by "delete_volume" :: held 0.628s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created reservations ['550c73b3-a077-458f-a29b-875387b02f84', 'fe50f993-82ef-44fd-9fbc-7d996ba44cf0', '5897e69b-4d1a-4689-8cd5-758264177384', '75440371-4c35-4b2c-8e14-f3ddb98794da'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:29 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:29 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:30 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.228s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:30 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Deleted volume successfully. Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-e31a315e-6fe1-4828-86b3-ba387bcd17c0 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-a50d1684-26e3-492b-b77c-be96461dc4ed-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-a8475f16-0d88-4efd-9ed6-ebb6521879d2-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-a8475f16-0d88-4efd-9ed6-ebb6521879d2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-quobyte-a8475f16-0d88-4efd-9ed6-ebb6521879d2" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-a8475f16-0d88-4efd-9ed6-ebb6521879d2" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada7d53e-83ab-4a4b-8927-487484da8b1c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:30 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2 Jul 15 18:48:30 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:30 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2" returned: 0 in 0.362s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:30 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2 Jul 15 18:48:30 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:31 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-a8475f16-0d88-4efd-9ed6-ebb6521879d2" returned: 0 in 0.246s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-a8475f16-0d88-4efd-9ed6-ebb6521879d2" released by "delete_volume" :: held 0.646s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created reservations ['1a56956a-5c2a-41bf-8781-47570f176be3', '7996baeb-6c7b-4597-8f04-39afd3125c27', '62fe3371-9996-440e-b974-6fe581331d01', '19efe7c8-52e4-44ee-a3f1-24568134ac93'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:31 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:31 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:31 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.244s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Deleted volume successfully. Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-64f3727e-1804-4f2b-b07b-920c224f7c34 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-a8475f16-0d88-4efd-9ed6-ebb6521879d2-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-9649486e-0e9f-4f18-97ef-f50085bb0a61-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-9649486e-0e9f-4f18-97ef-f50085bb0a61-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "cinder-quobyte-9649486e-0e9f-4f18-97ef-f50085bb0a61" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-9649486e-0e9f-4f18-97ef-f50085bb0a61" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbec4364-981f-421a-a7d7-a8230d79a0ee]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:31 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61 Jul 15 18:48:31 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:32 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61" returned: 0 in 0.347s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:32 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61 Jul 15 18:48:32 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:32 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9649486e-0e9f-4f18-97ef-f50085bb0a61" returned: 0 in 0.249s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-quobyte-9649486e-0e9f-4f18-97ef-f50085bb0a61" released by "delete_volume" :: held 0.638s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Created reservations ['947c938d-7bf7-4bfe-b65a-34e459ad2492', '5297b5da-67f8-4259-a032-ed3a28357bfe', '122ef100-d711-4064-ac0a-3085a10d01ff', '2eff5d50-f64d-4922-ae1a-2d8339aa0ce3'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:32 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:32 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:32 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.229s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:32 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Deleted volume successfully. Jul 15 18:48:32 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66549d53-6e52-49e4-9e34-4505e5b8f555 tempest-CreateVolumesFromSourceVolumeTest-1028976198 None] Lock "cinder-9649486e-0e9f-4f18-97ef-f50085bb0a61-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:35 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:35 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:35 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.234s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:48:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:48:42 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=135,cinder:SELECT=90,cinder:INSERT=32,cinder:DELETE=12 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Flow 'volume_create_manager' (6a1b448e-fdf5-40fa-8cab-953ce736cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acae78c-a95f-47cc-8a7b-aa4574fac741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acae78c-a95f-47cc-8a7b-aa4574fac741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1395400983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67be810-fea4-43d4-ad49-4723f6e5552d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce99e2c20664393804bcd648729bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:44Z,use_quota=True,user_id='d230e53bbf48404ca080b1bf4e25ed10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3224eb06-bc26-49dd-8dd3-b96e2c20a84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3224eb06-bc26-49dd-8dd3-b96e2c20a84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc12453b-cb8a-44e7-b06d-17ea70114f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc12453b-cb8a-44e7-b06d-17ea70114f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67be810-fea4-43d4-ad49-4723f6e5552d', 'volume_name': 'volume-c67be810-fea4-43d4-ad49-4723f6e5552d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd63346e-701c-40fd-aa58-4338495dcd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd63346e-701c-40fd-aa58-4338495dcd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3316bcc8-8c24-46a3-8385-d92a5046c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:44 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Volume c67be810-fea4-43d4-ad49-4723f6e5552d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67be810-fea4-43d4-ad49-4723f6e5552d', 'volume_size': 1} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1395400983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67be810-fea4-43d4-ad49-4723f6e5552d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce99e2c20664393804bcd648729bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:44Z,use_quota=True,user_id='d230e53bbf48404ca080b1bf4e25ed10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Creating volume c67be810-fea4-43d4-ad49-4723f6e5552d {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:44 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:44 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d 1073741824 Jul 15 18:48:44 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (a33aaa99-0da8-473f-9713-424ef82a7c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ce0996-c31e-479f-9da4-e2e9cbb934ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ce0996-c31e-479f-9da4-e2e9cbb934ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1122466270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45dfaf6-67ff-4c7b-9541-0796600486f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:44Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2ff4de-c980-43fe-870f-dfbb02241a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2ff4de-c980-43fe-870f-dfbb02241a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb43216e-6df9-4480-afcc-3db9dea4c8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb43216e-6df9-4480-afcc-3db9dea4c8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45dfaf6-67ff-4c7b-9541-0796600486f9', 'volume_name': 'volume-f45dfaf6-67ff-4c7b-9541-0796600486f9', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b2dde4-4478-47d3-8dfb-9f5d8e2d3395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b2dde4-4478-47d3-8dfb-9f5d8e2d3395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90730c14-ce7a-416f-bfc7-80b96958c896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:44 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume f45dfaf6-67ff-4c7b-9541-0796600486f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45dfaf6-67ff-4c7b-9541-0796600486f9', 'volume_size': 1} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:44 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d 1073741824" returned: 0 in 0.720s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:45 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d Jul 15 18:48:45 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Flow 'volume_create_manager' (88cb3c35-47e0-4d3c-bcae-25e91a72147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a6d306-2d06-4e49-8e8e-5e6f75fedb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a6d306-2d06-4e49-8e8e-5e6f75fedb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-474408612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2937dae-4308-44e5-8f23-4e8e33f85bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e965c81009434996c55de785f060ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:45Z,use_quota=True,user_id='053be8262d6a48fb8c9cd7359ea57e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f1cd51-7bd3-4555-9a72-e4c72ad0333b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f1cd51-7bd3-4555-9a72-e4c72ad0333b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c01fbf-24c6-4c02-84b5-d3d6462285c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c01fbf-24c6-4c02-84b5-d3d6462285c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2937dae-4308-44e5-8f23-4e8e33f85bda', 'volume_name': 'volume-b2937dae-4308-44e5-8f23-4e8e33f85bda', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb2b161-b9be-4483-b9d0-b11101867c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb2b161-b9be-4483-b9d0-b11101867c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de3d236-9e59-443d-a923-d6bce62dda3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Volume b2937dae-4308-44e5-8f23-4e8e33f85bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2937dae-4308-44e5-8f23-4e8e33f85bda', 'volume_size': 1} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:45 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d" returned: 0 in 0.339s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1122466270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45dfaf6-67ff-4c7b-9541-0796600486f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:44Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Creating volume f45dfaf6-67ff-4c7b-9541-0796600486f9 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:45 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:45 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 1073741824 Jul 15 18:48:45 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3316bcc8-8c24-46a3-8385-d92a5046c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67be810-fea4-43d4-ad49-4723f6e5552d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6af97ad-14e2-44fa-9114-c800e5066aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Volume volume-c67be810-fea4-43d4-ad49-4723f6e5552d (c67be810-fea4-43d4-ad49-4723f6e5552d): created successfully Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6af97ad-14e2-44fa-9114-c800e5066aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Flow 'volume_create_manager' (6a1b448e-fdf5-40fa-8cab-953ce736cfba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Flow 'volume_create_manager' (28492527-21b3-4dc0-8ec5-b56b73c89028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d535be72-c4a8-4041-8e86-b093d6b4ace5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ee34b52a-364a-476d-b2b4-613242275674 tempest-CreateVolumesFromImageTest-2000928117 None] Created volume successfully. Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d535be72-c4a8-4041-8e86-b093d6b4ace5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1468783608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef35a26-d52f-48c2-a831-60bdf6c72156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce99e2c20664393804bcd648729bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:45Z,use_quota=True,user_id='d230e53bbf48404ca080b1bf4e25ed10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e2d824-6fa8-4e8e-8daf-967c61bb41a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e2d824-6fa8-4e8e-8daf-967c61bb41a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66191d4-f22a-4ec1-b27b-53930264107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66191d4-f22a-4ec1-b27b-53930264107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef35a26-d52f-48c2-a831-60bdf6c72156', 'volume_name': 'volume-6ef35a26-d52f-48c2-a831-60bdf6c72156', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505ce951-bb53-4962-8a62-f8eaad9ee6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505ce951-bb53-4962-8a62-f8eaad9ee6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b03938-3fbf-4ffc-9db7-05488cbb7a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Volume 6ef35a26-d52f-48c2-a831-60bdf6c72156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef35a26-d52f-48c2-a831-60bdf6c72156', 'volume_size': 1} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Flow 'volume_create_manager' (1f72c3d5-685e-41aa-b35c-3af9383976e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87198a26-45a8-485f-a83c-03ec221558dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87198a26-45a8-485f-a83c-03ec221558dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-576796358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957b57b8-af82-4141-b1b5-c5fced488170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce99e2c20664393804bcd648729bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:45Z,use_quota=True,user_id='d230e53bbf48404ca080b1bf4e25ed10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4133b5bc-24d2-4789-963f-223579912412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4133b5bc-24d2-4789-963f-223579912412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df30bb00-5d22-49ec-96b0-f7db305143a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df30bb00-5d22-49ec-96b0-f7db305143a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '957b57b8-af82-4141-b1b5-c5fced488170', 'volume_name': 'volume-957b57b8-af82-4141-b1b5-c5fced488170', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c79a47d-8034-46c8-acb4-a43d72a353df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c79a47d-8034-46c8-acb4-a43d72a353df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b269341a-8389-45dd-bbbb-95939c6cdd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:45 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Volume 957b57b8-af82-4141-b1b5-c5fced488170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-957b57b8-af82-4141-b1b5-c5fced488170', 'volume_size': 1} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:45 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Flow 'volume_create_manager' (3474997a-608c-44e5-bcb6-9a9ecad1b208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bae0e6-8ac1-4855-bf1b-63c04f5256e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bae0e6-8ac1-4855-bf1b-63c04f5256e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1289498611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e6279d-6bbf-42c6-969c-b51de2cccaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce99e2c20664393804bcd648729bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:46Z,use_quota=True,user_id='d230e53bbf48404ca080b1bf4e25ed10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:46 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9edb9b4-c2cf-44ae-a908-83fd05eec741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9edb9b4-c2cf-44ae-a908-83fd05eec741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfa7aed-b875-4599-94d4-04492f6da398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfa7aed-b875-4599-94d4-04492f6da398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e6279d-6bbf-42c6-969c-b51de2cccaf3', 'volume_name': 'volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1adf228-36ab-4c5f-9e6a-a482de593948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1adf228-36ab-4c5f-9e6a-a482de593948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d94de9-fd3a-4697-81cb-ff38946a55cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Volume f9e6279d-6bbf-42c6-969c-b51de2cccaf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3', 'volume_size': 1} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 1073741824" returned: 0 in 0.730s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:46 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 Jul 15 18:48:46 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:46 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9" returned: 0 in 0.322s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.142s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-474408612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2937dae-4308-44e5-8f23-4e8e33f85bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e965c81009434996c55de785f060ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:45Z,use_quota=True,user_id='053be8262d6a48fb8c9cd7359ea57e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Creating volume b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:46 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:46 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda 1073741824 Jul 15 18:48:46 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Flow 'volume_create_manager' (0565c387-de62-4c2c-be18-3e54d4185d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd49cf03-7cef-4eaa-9323-59b0e5be4719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90730c14-ce7a-416f-bfc7-80b96958c896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45dfaf6-67ff-4c7b-9541-0796600486f9', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3769ec16-d37d-43bc-b896-f49ccc6ac6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd49cf03-7cef-4eaa-9323-59b0e5be4719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-246728008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1b357c-e960-422b-843b-3b653ba091d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce99e2c20664393804bcd648729bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:46Z,use_quota=True,user_id='d230e53bbf48404ca080b1bf4e25ed10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e336313c-678b-49ac-86d3-507de8e685b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e336313c-678b-49ac-86d3-507de8e685b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95266335-fe34-4c42-b33c-643535c6fe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95266335-fe34-4c42-b33c-643535c6fe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1b357c-e960-422b-843b-3b653ba091d0', 'volume_name': 'volume-df1b357c-e960-422b-843b-3b653ba091d0', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7dcbd2a-7dc4-465f-a3f3-a1fc6f7afe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7dcbd2a-7dc4-465f-a3f3-a1fc6f7afe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149bc52b-dfa2-402e-9637-34da3ffccfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:46 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Volume df1b357c-e960-422b-843b-3b653ba091d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1b357c-e960-422b-843b-3b653ba091d0', 'volume_size': 1} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:46 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 (f45dfaf6-67ff-4c7b-9541-0796600486f9): created successfully Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3769ec16-d37d-43bc-b896-f49ccc6ac6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (a33aaa99-0da8-473f-9713-424ef82a7c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:46 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-bc31fb18-ebe6-4350-89a1-4337510302b8 tempest-CreateVolumesFromSnapshotTest-702727735 None] Created volume successfully. Jul 15 18:48:46 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda 1073741824" returned: 0 in 0.494s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:47 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda Jul 15 18:48:47 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:47 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda" returned: 0 in 0.260s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1468783608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef35a26-d52f-48c2-a831-60bdf6c72156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce99e2c20664393804bcd648729bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:45Z,use_quota=True,user_id='d230e53bbf48404ca080b1bf4e25ed10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Creating volume 6ef35a26-d52f-48c2-a831-60bdf6c72156 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:47 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de3d236-9e59-443d-a923-d6bce62dda3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2937dae-4308-44e5-8f23-4e8e33f85bda', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:47 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156 1073741824 Jul 15 18:48:47 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd95e042-650c-4c67-921f-9ae0b0ba8b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:47 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Volume volume-b2937dae-4308-44e5-8f23-4e8e33f85bda (b2937dae-4308-44e5-8f23-4e8e33f85bda): created successfully Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd95e042-650c-4c67-921f-9ae0b0ba8b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Flow 'volume_create_manager' (88cb3c35-47e0-4d3c-bcae-25e91a72147b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:47 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b3eb8ce8-8808-4cca-a907-8e77242d36f3 tempest-VolumeDependencyTests-1080159501 None] Created volume successfully. Jul 15 18:48:47 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156 1073741824" returned: 0 in 0.512s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:47 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156 Jul 15 18:48:47 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:48 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156" returned: 0 in 0.284s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.248s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-576796358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957b57b8-af82-4141-b1b5-c5fced488170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce99e2c20664393804bcd648729bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:45Z,use_quota=True,user_id='d230e53bbf48404ca080b1bf4e25ed10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Creating volume 957b57b8-af82-4141-b1b5-c5fced488170 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:48 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b03938-3fbf-4ffc-9db7-05488cbb7a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef35a26-d52f-48c2-a831-60bdf6c72156', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:48 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170 1073741824 Jul 15 18:48:48 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab4100b-e3c9-4051-a54a-964a8c4e2e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:48 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Volume volume-6ef35a26-d52f-48c2-a831-60bdf6c72156 (6ef35a26-d52f-48c2-a831-60bdf6c72156): created successfully Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab4100b-e3c9-4051-a54a-964a8c4e2e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Flow 'volume_create_manager' (28492527-21b3-4dc0-8ec5-b56b73c89028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4032a4b2-dd3c-47c2-bda8-1fbcaa05f35b tempest-CreateVolumesFromImageTest-2000928117 None] Created volume successfully. Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:48 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170 1073741824" returned: 0 in 0.520s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:48 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170 Jul 15 18:48:48 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Flow 'volume_create_manager' (20034452-89ec-4b1c-8be2-1d4cd78389c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d28c3f-6bdd-40a9-ac51-785ae8165902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d28c3f-6bdd-40a9-ac51-785ae8165902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26295dd2-60eb-4470-9d99-f0cfbeb45d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e3ce2f0519491e838762816744d1f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:49Z,use_quota=True,user_id='0757cb8842bc4d0384a5ee5b57164fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1f3af7-57d1-41cc-a483-488c35cca56f),volume_type_id=6c1f3af7-57d1-41cc-a483-488c35cca56f)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ffcf4e-4a68-4943-8267-539dedd3e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ffcf4e-4a68-4943-8267-539dedd3e229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7013645-3210-4a10-9b00-4c633523078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.image.glance [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Creating Keystone auth plugin from conf {{(pid=87863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:48:48 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170" returned: 0 in 0.243s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.886s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1289498611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e6279d-6bbf-42c6-969c-b51de2cccaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce99e2c20664393804bcd648729bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:46Z,use_quota=True,user_id='d230e53bbf48404ca080b1bf4e25ed10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Creating volume f9e6279d-6bbf-42c6-969c-b51de2cccaf3 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:48 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:49 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3 1073741824 Jul 15 18:48:49 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b269341a-8389-45dd-bbbb-95939c6cdd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957b57b8-af82-4141-b1b5-c5fced488170', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11dc1ad-54f9-453c-9b00-049654b1a648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:49 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Volume volume-957b57b8-af82-4141-b1b5-c5fced488170 (957b57b8-af82-4141-b1b5-c5fced488170): created successfully Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11dc1ad-54f9-453c-9b00-049654b1a648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Flow 'volume_create_manager' (1f72c3d5-685e-41aa-b35c-3af9383976e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:49 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1c29ce43-4df4-492d-8edf-2c4e20e362cd tempest-CreateVolumesFromImageTest-2000928117 None] Created volume successfully. Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7013645-3210-4a10-9b00-4c633523078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26295dd2-60eb-4470-9d99-f0cfbeb45d85', 'volume_name': 'volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85', 'volume_size': 1, 'image_id': '2ce23b60-de08-4d84-8f12-8970ed61f676', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ce23b60-de08-4d84-8f12-8970ed61f676', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18992435b23b3bfe21dec43ff9807870', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4e3ce2f0519491e838762816744d1f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9e67a0213acef5ebc0a66d2a6a915823dbc5913798d63fbcf06c548607c5e784eac779ba1eabe3265aa4ee44a9cd0e5f2a36c05f0e8f69ae309f5e1e3496316', 'id': '2ce23b60-de08-4d84-8f12-8970ed61f676', 'created_at': datetime.datetime(2026, 7, 15, 16, 48, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 48, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ce23b60-de08-4d84-8f12-8970ed61f676/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb2a7ac-f1d8-4231-ac63-51748a2f27b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb2a7ac-f1d8-4231-ac63-51748a2f27b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24166d04-3924-460c-aad4-ffd20e630b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:49 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Volume 26295dd2-60eb-4470-9d99-f0cfbeb45d85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85', 'volume_size': 1, 'image_id': '2ce23b60-de08-4d84-8f12-8970ed61f676', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ce23b60-de08-4d84-8f12-8970ed61f676', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18992435b23b3bfe21dec43ff9807870', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4e3ce2f0519491e838762816744d1f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9e67a0213acef5ebc0a66d2a6a915823dbc5913798d63fbcf06c548607c5e784eac779ba1eabe3265aa4ee44a9cd0e5f2a36c05f0e8f69ae309f5e1e3496316', 'id': '2ce23b60-de08-4d84-8f12-8970ed61f676', 'created_at': datetime.datetime(2026, 7, 15, 16, 48, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 48, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ce23b60-de08-4d84-8f12-8970ed61f676/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Trying to clone 26295dd2-60eb-4470-9d99-f0cfbeb45d85 from image 2ce23b60-de08-4d84-8f12-8970ed61f676 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ce23b60-de08-4d84-8f12-8970ed61f676', 'metadata': {}}]). {{(pid=87863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:48:49 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Image download 0.00 MB at 0.00 MB/s Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fae2b61-69cd-4015-8a49-709bbc22cfa5]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:49 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD Jul 15 18:48:49 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:49 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3 1073741824" returned: 0 in 0.462s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:49 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3 Jul 15 18:48:49 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:49 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:49 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD Jul 15 18:48:49 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:49 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3" returned: 0 in 0.278s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.164s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-246728008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1b357c-e960-422b-843b-3b653ba091d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce99e2c20664393804bcd648729bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:46Z,use_quota=True,user_id='d230e53bbf48404ca080b1bf4e25ed10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Creating volume df1b357c-e960-422b-843b-3b653ba091d0 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:49 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:49 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0 1073741824 Jul 15 18:48:49 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d94de9-fd3a-4697-81cb-ff38946a55cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc54e164-6279-4dc4-ab34-fc532eb968ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:49 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Volume volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3 (f9e6279d-6bbf-42c6-969c-b51de2cccaf3): created successfully Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc54e164-6279-4dc4-ab34-fc532eb968ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Flow 'volume_create_manager' (3474997a-608c-44e5-bcb6-9a9ecad1b208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:49 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f7cdaca3-4597-420f-913b-77b85e2f3e57 tempest-CreateVolumesFromImageTest-2000928117 None] Created volume successfully. Jul 15 18:48:49 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:49 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Temporary image 2ce23b60-de08-4d84-8f12-8970ed61f676 is fetched for user 0757cb8842bc4d0384a5ee5b57164fc1. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c782d4-5ff3-449f-902a-e11a4b018524]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:50 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD Jul 15 18:48:50 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:50 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0 1073741824" returned: 0 in 0.419s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:50 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0 Jul 15 18:48:50 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:50 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:50 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0" returned: 0 in 0.259s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:50 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD Jul 15 18:48:50 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.391s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149bc52b-dfa2-402e-9637-34da3ffccfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1b357c-e960-422b-843b-3b653ba091d0', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afccb7d-9017-481c-9ff5-a841798cf801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Creating offline snapshot e9d498ac-d4c0-4a3a-a25c-963b0415546e of volume f45dfaf6-67ff-4c7b-9541-0796600486f9 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:50 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Volume volume-df1b357c-e960-422b-843b-3b653ba091d0 (df1b357c-e960-422b-843b-3b653ba091d0): created successfully Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afccb7d-9017-481c-9ff5-a841798cf801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Flow 'volume_create_manager' (0565c387-de62-4c2c-be18-3e54d4185d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c66ee0-fb98-48aa-84cd-6e7bc4c322f5]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6aa2ac5a-3fe2-428d-8e28-8a24cb3bfa68 tempest-CreateVolumesFromImageTest-2000928117 None] Created volume successfully. Jul 15 18:48:50 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 Jul 15 18:48:50 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:50 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:50 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "cinder-df1b357c-e960-422b-843b-3b653ba091d0-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9" returned: 0 in 0.417s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-df1b357c-e960-422b-843b-3b653ba091d0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:50 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e 1G Jul 15 18:48:50 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "cinder-quobyte-df1b357c-e960-422b-843b-3b653ba091d0" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-quobyte-df1b357c-e960-422b-843b-3b653ba091d0" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b48d248-cc90-4830-9056-96cf72446b57]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:51 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0 Jul 15 18:48:51 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:51 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e 1G" returned: 0 in 0.416s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:51 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e Jul 15 18:48:51 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:51 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0" returned: 0 in 0.376s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:51 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0 Jul 15 18:48:51 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:51 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e" returned: 0 in 0.303s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:51 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e is being set with open permissions: ugo+rw Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:51 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-df1b357c-e960-422b-843b-3b653ba091d0" returned: 0 in 0.252s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:51 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e Jul 15 18:48:51 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-quobyte-df1b357c-e960-422b-843b-3b653ba091d0" released by "delete_volume" :: held 0.680s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Created reservations ['4e3fcd26-224f-4d31-b768-db45585a8215', 'a228dae5-66c5-49f7-bb0e-01c90e76aad0', 'b74cc095-2728-4ffb-b81b-50ce514e7757', 'be482940-76fa-49b0-abf0-24f049bbfaf2'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:51 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:51 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:51 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e" returned: 0 in 0.243s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:51 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.info Jul 15 18:48:51 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:52 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.241s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:52 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Deleted volume successfully. Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "cinder-f9e6279d-6bbf-42c6-969c-b51de2cccaf3-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-77459b54-0d5d-4d50-8943-efd282c7b7dc tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-df1b357c-e960-422b-843b-3b653ba091d0-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-f9e6279d-6bbf-42c6-969c-b51de2cccaf3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "cinder-quobyte-f9e6279d-6bbf-42c6-969c-b51de2cccaf3" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-quobyte-f9e6279d-6bbf-42c6-969c-b51de2cccaf3" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:52 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.info" returned: 0 in 0.262s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:52 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.info is being set with open permissions: ugo+rw Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcd5fb4-a80d-4f32-bebb-d188ecc17af3]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:52 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.info Jul 15 18:48:52 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:52 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3 Jul 15 18:48:52 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:52 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.info" returned: 0 in 0.255s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.179s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Creating offline snapshot 5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 of volume b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:52 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f4d33ae8-ffdd-4c10-8590-c54838c7de87 tempest-CreateVolumesFromSnapshotTest-702727735 None] Create snapshot completed successfully Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b84a45-4257-44ee-a108-ef2f5976cc6a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:52 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3" returned: 0 in 0.381s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:52 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3 Jul 15 18:48:52 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:52 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda Jul 15 18:48:52 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:52 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f9e6279d-6bbf-42c6-969c-b51de2cccaf3" returned: 0 in 0.268s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-quobyte-f9e6279d-6bbf-42c6-969c-b51de2cccaf3" released by "delete_volume" :: held 0.701s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:52 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda" returned: 0 in 0.400s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:52 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Created reservations ['7476f5c7-4ea1-454d-89ec-c50324c04286', '3b56d261-49c0-4e5a-87c1-72927befea2f', '1e9c478f-162f-44ed-811d-c09adcf3df51', 'abd835fe-c22e-4826-9313-4414caf4841f'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:52 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 1G Jul 15 18:48:52 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:53 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:53 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "cinder-957b57b8-af82-4141-b1b5-c5fced488170-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:53 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-957b57b8-af82-4141-b1b5-c5fced488170-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.296s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:53 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Deleted volume successfully. Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0356a282-14f4-4efa-9131-f540468b0db0 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-f9e6279d-6bbf-42c6-969c-b51de2cccaf3-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "cinder-quobyte-957b57b8-af82-4141-b1b5-c5fced488170" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-quobyte-957b57b8-af82-4141-b1b5-c5fced488170" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf33274-1258-4d74-8ec9-585304a78c1b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:53 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 1G" returned: 0 in 0.534s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2937dae-4308-44e5-8f23-4e8e33f85bda -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:53 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2937dae-4308-44e5-8f23-4e8e33f85bda -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 Jul 15 18:48:53 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:53 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170 Jul 15 18:48:53 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:53 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2937dae-4308-44e5-8f23-4e8e33f85bda -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6" returned: 0 in 0.378s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:53 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 is being set with open permissions: ugo+rw Jul 15 18:48:53 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170" returned: 0 in 0.408s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:53 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 Jul 15 18:48:53 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:53 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170 Jul 15 18:48:53 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (1735d794-2c25-4b22-ac58-c4a95c2f0bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40247ca4-0a68-4639-8b6a-7e9f803d7c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40247ca4-0a68-4639-8b6a-7e9f803d7c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1078680177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513918b2-1ccf-4060-bd96-c15c51b41a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:54Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6ceff4-ef13-4094-85e3-9f9482c89fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6ceff4-ef13-4094-85e3-9f9482c89fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e769a1-047f-4de9-bfc8-55bd28d2766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e769a1-047f-4de9-bfc8-55bd28d2766b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513918b2-1ccf-4060-bd96-c15c51b41a3d', 'volume_name': 'volume-513918b2-1ccf-4060-bd96-c15c51b41a3d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6301d898-1d49-496e-bab8-ecff9344a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6301d898-1d49-496e-bab8-ecff9344a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a566a1a-7274-4f22-ac2a-7be239f1bc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume 513918b2-1ccf-4060-bd96-c15c51b41a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513918b2-1ccf-4060-bd96-c15c51b41a3d', 'volume_size': 1} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:54 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6" returned: 0 in 0.299s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:54 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-957b57b8-af82-4141-b1b5-c5fced488170" returned: 0 in 0.332s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-quobyte-957b57b8-af82-4141-b1b5-c5fced488170" released by "delete_volume" :: held 0.826s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:54 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.info Jul 15 18:48:54 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Created reservations ['e9692ebd-f92d-49d5-a895-56dd76603614', 'cd075758-6258-4ea5-a016-5e0d7900e0d3', '8a047c32-5325-435f-9907-5a392de9350d', '0e5efec9-2b61-470f-a497-960809c6096b'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:54 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:54 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (776b3c84-d4f3-4412-a648-6164841fbf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad1c362-04a2-41ec-829b-271e9312cc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "cinder-6ef35a26-d52f-48c2-a831-60bdf6c72156-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad1c362-04a2-41ec-829b-271e9312cc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120036385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8304542f-e337-4274-8951-f7c269a6ec73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:54Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:54 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c3e9be-6e5f-4b84-a8c6-fdec79282d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c3e9be-6e5f-4b84-a8c6-fdec79282d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a413bee-e0d6-4f75-b03f-e3023ffbb06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a413bee-e0d6-4f75-b03f-e3023ffbb06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8304542f-e337-4274-8951-f7c269a6ec73', 'volume_name': 'volume-8304542f-e337-4274-8951-f7c269a6ec73', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a173b65-17e3-4d58-b96b-0c2c8f8b2969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a173b65-17e3-4d58-b96b-0c2c8f8b2969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5af5c46-0109-4de0-8b41-f72b0268e81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume 8304542f-e337-4274-8951-f7c269a6ec73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8304542f-e337-4274-8951-f7c269a6ec73', 'volume_size': 1} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.info" returned: 0 in 0.427s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:54 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.info is being set with open permissions: ugo+rw Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-6ef35a26-d52f-48c2-a831-60bdf6c72156-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:54 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.info Jul 15 18:48:54 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "cinder-quobyte-6ef35a26-d52f-48c2-a831-60bdf6c72156" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:54 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-quobyte-6ef35a26-d52f-48c2-a831-60bdf6c72156" acquired by "delete_volume" :: waited 0.041s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.428s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Deleted volume successfully. Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f34b521-816a-4d49-bf3d-117a229ffd71]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-87e73cdc-2cb3-4c4a-b0f2-36f72dc08501 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-957b57b8-af82-4141-b1b5-c5fced488170-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (f82e3069-6a7f-4208-ba29-45f97f438cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b05ea-d4eb-46c9-b5f4-4366d4822021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b05ea-d4eb-46c9-b5f4-4366d4822021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1142929186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dae531-a8fe-49bd-9dc0-46408a443f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:55Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:54 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156 Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a82fec7-9813-4677-8c3a-32f421c896bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:54 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a82fec7-9813-4677-8c3a-32f421c896bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b152755-63ff-4298-8ea6-7f3eb477bbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b152755-63ff-4298-8ea6-7f3eb477bbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39dae531-a8fe-49bd-9dc0-46408a443f2f', 'volume_name': 'volume-39dae531-a8fe-49bd-9dc0-46408a443f2f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7305ff8c-7e8b-469d-a498-ab3a61e614a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7305ff8c-7e8b-469d-a498-ab3a61e614a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605f6581-535b-4653-aba6-7d6bed411f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume 39dae531-a8fe-49bd-9dc0-46408a443f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39dae531-a8fe-49bd-9dc0-46408a443f2f', 'volume_size': 1} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:55 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.info" returned: 0 in 0.379s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.360s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26295dd2-60eb-4470-9d99-f0cfbeb45d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e3ce2f0519491e838762816744d1f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:49Z,use_quota=True,user_id='0757cb8842bc4d0384a5ee5b57164fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c1f3af7-57d1-41cc-a483-488c35cca56f),volume_type_id=6c1f3af7-57d1-41cc-a483-488c35cca56f)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Creating volume 26295dd2-60eb-4470-9d99-f0cfbeb45d85 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:55 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:55 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 1073741824 Jul 15 18:48:55 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:55 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3edd1119-50ce-4295-b221-b9e8c12c1f24 tempest-VolumeDependencyTests-1080159501 None] Create snapshot completed successfully Jul 15 18:48:55 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156" returned: 0 in 0.480s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:55 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156 Jul 15 18:48:55 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (9bf4688e-a4f8-4b5d-a81a-acf842b30181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37e5c1c-b987-4c53-968c-e3cb79aa17ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37e5c1c-b987-4c53-968c-e3cb79aa17ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346035934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:55Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a9b3cc-4e34-4ad3-9c04-8566455f59df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a9b3cc-4e34-4ad3-9c04-8566455f59df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b94884-db21-456a-b84b-e1b9d2029479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b94884-db21-456a-b84b-e1b9d2029479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb', 'volume_name': 'volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378051dc-0ebf-4bf2-8607-a572d735c184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378051dc-0ebf-4bf2-8607-a572d735c184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3c4024-2720-455a-801b-944bd86a564d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume 25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb', 'volume_size': 1} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:55 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 1073741824" returned: 0 in 0.529s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:55 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6ef35a26-d52f-48c2-a831-60bdf6c72156" returned: 0 in 0.362s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:55 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 Jul 15 18:48:55 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-quobyte-6ef35a26-d52f-48c2-a831-60bdf6c72156" released by "delete_volume" :: held 0.925s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Created reservations ['c516effe-28ab-4d72-b00f-95a8a45a21d2', 'ccd48264-209f-4670-8a09-70d1614c9eb5', 'a2f873ac-9657-4e9f-9b12-1cda0176525d', 'cc0a9544-cd9b-4d42-8492-6f538bc93dff'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (d8d61851-5ef2-4ce4-a295-5a2d856cb9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4696907-cc51-4cb8-8f36-a1e2557c0160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4696907-cc51-4cb8-8f36-a1e2557c0160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216239515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ef9c5b-7487-4fd5-b38e-c7780b5c0562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:56Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53d603f-2ab1-4f6c-81dd-8c3b39650185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53d603f-2ab1-4f6c-81dd-8c3b39650185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407fec69-dbc2-43d1-9cfb-98e27c1c3d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407fec69-dbc2-43d1-9cfb-98e27c1c3d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ef9c5b-7487-4fd5-b38e-c7780b5c0562', 'volume_name': 'volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12cca81-2328-440c-b61f-92d5712672a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12cca81-2328-440c-b61f-92d5712672a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df93eceb-4257-4740-990a-608e8000ebdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:55 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume 08ef9c5b-7487-4fd5-b38e-c7780b5c0562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562', 'volume_size': 1} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85" returned: 0 in 0.337s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.853s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1078680177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513918b2-1ccf-4060-bd96-c15c51b41a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:54Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Creating volume 513918b2-1ccf-4060-bd96-c15c51b41a3d {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:56 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d 1073741824 Jul 15 18:48:56 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Attempting download of 2ce23b60-de08-4d84-8f12-8970ed61f676 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ce23b60-de08-4d84-8f12-8970ed61f676', 'metadata': {}}])) to volume 26295dd2-60eb-4470-9d99-f0cfbeb45d85. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:48:56 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:56 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c14d3eb-069a-4d37-9018-77c95fc8b9c9]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ce23b60-de08-4d84-8f12-8970ed61f676_vi4e7zha {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ce23b60-de08-4d84-8f12-8970ed61f676_vi4e7zha Jul 15 18:48:56 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.299s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:56 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Deleted volume successfully. Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cf6306b6-4293-446e-82b5-9f14b927a8c7 tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-6ef35a26-d52f-48c2-a831-60bdf6c72156-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=143,cinder:INSERT=49,cinder:UPDATE=206,cinder:DELETE=20 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Flow 'volume_create_manager' (6bbcd563-e497-472a-ba78-08ed24f4c5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9aec2d2-1dc4-4da1-8812-04ae9585d182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9aec2d2-1dc4-4da1-8812-04ae9585d182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1735181840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b766a4a-3352-40c2-8264-d55dd46b38d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e965c81009434996c55de785f060ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:56Z,use_quota=True,user_id='053be8262d6a48fb8c9cd7359ea57e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee8f654-8709-451b-8f2c-5b351134b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee8f654-8709-451b-8f2c-5b351134b51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee70f33-51af-426c-95f7-7dbb13fc8202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee70f33-51af-426c-95f7-7dbb13fc8202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1b766a4a-3352-40c2-8264-d55dd46b38d8', 'volume_name': 'volume-1b766a4a-3352-40c2-8264-d55dd46b38d8', 'volume_size': 1, 'snapshot_id': '5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85e3f2b-09c4-42b4-b7af-cb7001e5c889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85e3f2b-09c4-42b4-b7af-cb7001e5c889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d66b14-ca5a-4a15-86e4-67729cfe8a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:56 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Volume 1b766a4a-3352-40c2-8264-d55dd46b38d8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1b766a4a-3352-40c2-8264-d55dd46b38d8', 'volume_size': 1, 'snapshot_id': '5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6'} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:56 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d 1073741824" returned: 0 in 0.554s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ce23b60-de08-4d84-8f12-8970ed61f676_vi4e7zha" returned: 0 in 0.455s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce23b60-de08-4d84-8f12-8970ed61f676_vi4e7zha {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d Jul 15 18:48:56 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce23b60-de08-4d84-8f12-8970ed61f676_vi4e7zha Jul 15 18:48:56 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d" returned: 0 in 0.249s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.214s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120036385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8304542f-e337-4274-8951-f7c269a6ec73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:54Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Creating volume 8304542f-e337-4274-8951-f7c269a6ec73 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:56 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "cinder-c67be810-fea4-43d4-ad49-4723f6e5552d-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:56 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73 1073741824 Jul 15 18:48:56 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a566a1a-7274-4f22-ac2a-7be239f1bc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513918b2-1ccf-4060-bd96-c15c51b41a3d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70d26a8-3437-451e-a281-d60bee249bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:56 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-c67be810-fea4-43d4-ad49-4723f6e5552d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:56 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume volume-513918b2-1ccf-4060-bd96-c15c51b41a3d (513918b2-1ccf-4060-bd96-c15c51b41a3d): created successfully Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70d26a8-3437-451e-a281-d60bee249bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (1735d794-2c25-4b22-ac58-c4a95c2f0bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce23b60-de08-4d84-8f12-8970ed61f676_vi4e7zha" returned: 1 in 0.378s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce23b60-de08-4d84-8f12-8970ed61f676_vi4e7zha' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e337ef-300c-48d9-a622-1be137464083]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7b1674f7-bfb4-4154-875b-a01659ff9884 tempest-CreateVolumesFromSnapshotTest-702727735 None] Created volume successfully. Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "cinder-quobyte-c67be810-fea4-43d4-ad49-4723f6e5552d" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-quobyte-c67be810-fea4-43d4-ad49-4723f6e5552d" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b41c4e8-2781-4f88-987b-4507966e7378]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD Jul 15 18:48:57 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d Jul 15 18:48:57 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73 1073741824" returned: 0 in 0.480s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:57 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73 Jul 15 18:48:57 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d" returned: 0 in 0.410s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD Jul 15 18:48:57 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d Jul 15 18:48:57 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73" returned: 0 in 0.244s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.639s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1142929186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dae531-a8fe-49bd-9dc0-46408a443f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:55Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Creating volume 39dae531-a8fe-49bd-9dc0-46408a443f2f {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:57 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5af5c46-0109-4de0-8b41-f72b0268e81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8304542f-e337-4274-8951-f7c269a6ec73', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:57 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f 1073741824 Jul 15 18:48:57 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117cd0d9-845e-432d-abf6-7d67e758710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] 2ce23b60-de08-4d84-8f12-8970ed61f676 was raw, converting to raw {{(pid=87863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c67be810-fea4-43d4-ad49-4723f6e5552d" returned: 0 in 0.277s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:57 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 Jul 15 18:48:57 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume volume-8304542f-e337-4274-8951-f7c269a6ec73 (8304542f-e337-4274-8951-f7c269a6ec73): created successfully Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117cd0d9-845e-432d-abf6-7d67e758710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (776b3c84-d4f3-4412-a648-6164841fbf02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-quobyte-c67be810-fea4-43d4-ad49-4723f6e5552d" released by "delete_volume" :: held 0.752s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:57 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-eb2cc091-a486-45db-a6c6-906eb4c0fc1e tempest-CreateVolumesFromSnapshotTest-702727735 None] Created volume successfully. Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Created reservations ['9422f434-b135-436b-88b2-c5edeb36e3b0', 'eb3b1b72-8cf8-450f-af05-fd1edaff1398', '6e75796e-9c8e-46ae-964e-dcc20433bfe1', 'b627ce50-0f4a-4976-b588-1c197cf4a677'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:48:57 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:58 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85" returned: 0 in 0.415s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ce23b60-de08-4d84-8f12-8970ed61f676_lzsiyididevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:48:58 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Converted 0.00 MB image at 0.00 MB/s Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:58 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 1G Jul 15 18:48:58 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:58 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f 1073741824" returned: 0 in 0.528s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:58 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.292s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:58 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Deleted volume successfully. Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8aaa7791-96db-4303-a0f7-dea33ae6b11b tempest-CreateVolumesFromImageTest-2000928117 None] Lock "cinder-c67be810-fea4-43d4-ad49-4723f6e5552d-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:58 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f Jul 15 18:48:58 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:58 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 1G" returned: 0 in 0.364s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:58 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca40860c-9d91-4427-8ce5-429c64585970]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f" returned: 0 in 0.312s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.088s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346035934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:55Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Creating volume 25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:58 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:58 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb 1073741824 Jul 15 18:48:58 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605f6581-535b-4653-aba6-7d6bed411f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39dae531-a8fe-49bd-9dc0-46408a443f2f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3808bd-ceae-4637-8307-4addfeeea617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:58 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume volume-39dae531-a8fe-49bd-9dc0-46408a443f2f (39dae531-a8fe-49bd-9dc0-46408a443f2f): created successfully Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3808bd-ceae-4637-8307-4addfeeea617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (f82e3069-6a7f-4208-ba29-45f97f438cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:58 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b1cadb24-7d3b-4a23-b9c3-83b53fe9ba3e tempest-CreateVolumesFromSnapshotTest-702727735 None] Created volume successfully. Jul 15 18:48:58 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 Jul 15 18:48:58 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:59 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85" returned: 0 in 0.468s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:59 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb 1073741824" returned: 0 in 0.504s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:59 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb Jul 15 18:48:59 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:59 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 Jul 15 18:48:59 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:59 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb" returned: 0 in 0.340s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.486s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216239515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ef9c5b-7487-4fd5-b38e-c7780b5c0562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b846b638d1f44c699273cdd6a1de2e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:56Z,use_quota=True,user_id='e8add0ebe17c4f85abfd44f3874ee0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Creating volume 08ef9c5b-7487-4fd5-b38e-c7780b5c0562 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:59 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3c4024-2720-455a-801b-944bd86a564d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:59 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562 1073741824 Jul 15 18:48:59 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714548d2-c7c4-4d24-8835-e8eeb09889e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:59 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85" returned: 1 in 0.530s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Downloaded image 2ce23b60-de08-4d84-8f12-8970ed61f676 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ce23b60-de08-4d84-8f12-8970ed61f676', 'metadata': {}}])) to volume 26295dd2-60eb-4470-9d99-f0cfbeb45d85 successfully. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Temporary image 2ce23b60-de08-4d84-8f12-8970ed61f676 for user 0757cb8842bc4d0384a5ee5b57164fc1 is deleted. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Marking volume 26295dd2-60eb-4470-9d99-f0cfbeb45d85 as bootable. {{(pid=87863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:48:59 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb (25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb): created successfully Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714548d2-c7c4-4d24-8835-e8eeb09889e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (9bf4688e-a4f8-4b5d-a81a-acf842b30181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Copying metadata from image 2ce23b60-de08-4d84-8f12-8970ed61f676 to 26295dd2-60eb-4470-9d99-f0cfbeb45d85. {{(pid=87863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Creating volume glance metadata for volume 26295dd2-60eb-4470-9d99-f0cfbeb45d85 backed by image 2ce23b60-de08-4d84-8f12-8970ed61f676 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2ce23b60-de08-4d84-8f12-8970ed61f676', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '18992435b23b3bfe21dec43ff9807870', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:48:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d3b14caa-7eb6-4fb0-9e3c-e024f943c06d tempest-CreateVolumesFromSnapshotTest-702727735 None] Created volume successfully. Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24166d04-3924-460c-aad4-ffd20e630b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85', 'volume_size': 1, 'image_id': '2ce23b60-de08-4d84-8f12-8970ed61f676', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ce23b60-de08-4d84-8f12-8970ed61f676', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18992435b23b3bfe21dec43ff9807870', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4e3ce2f0519491e838762816744d1f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9e67a0213acef5ebc0a66d2a6a915823dbc5913798d63fbcf06c548607c5e784eac779ba1eabe3265aa4ee44a9cd0e5f2a36c05f0e8f69ae309f5e1e3496316', 'id': '2ce23b60-de08-4d84-8f12-8970ed61f676', 'created_at': datetime.datetime(2026, 7, 15, 16, 48, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 48, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ce23b60-de08-4d84-8f12-8970ed61f676/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d1fc25-d0a1-4bbf-96b7-895711f30e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:59 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Volume volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 (26295dd2-60eb-4470-9d99-f0cfbeb45d85): created successfully Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d1fc25-d0a1-4bbf-96b7-895711f30e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Flow 'volume_create_manager' (20034452-89ec-4b1c-8be2-1d4cd78389c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5cd14447-1028-455e-9968-7cde6cfe15d6 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Created volume successfully. Jul 15 18:48:59 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562 1073741824" returned: 0 in 0.486s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:00 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562 Jul 15 18:49:00 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:00 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562" returned: 0 in 0.256s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.734s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "cinder-quobyte-5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6-1b766a4a-3352-40c2-8264-d55dd46b38d8" by "_create_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df93eceb-4257-4740-990a-608e8000ebdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23071692-34a6-4ced-b4eb-9e7dab9e2da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6-1b766a4a-3352-40c2-8264-d55dd46b38d8" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Creating volume 1b766a4a-3352-40c2-8264-d55dd46b38d8 from snapshot 5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 {{(pid=87863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "cinder-quobyte-1b766a4a-3352-40c2-8264-d55dd46b38d8" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:00 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Volume volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562 (08ef9c5b-7487-4fd5-b38e-c7780b5c0562): created successfully Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23071692-34a6-4ced-b4eb-9e7dab9e2da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Flow 'volume_create_manager' (d8d61851-5ef2-4ce4-a295-5a2d856cb9dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-1b766a4a-3352-40c2-8264-d55dd46b38d8" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] snapshot: 5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6, volume: 1b766a4a-3352-40c2-8264-d55dd46b38d8, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:49:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ac57538f-a4d2-4611-9481-5498998ac673 tempest-CreateVolumesFromSnapshotTest-702727735 None] Created volume successfully. Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e9ee42-c115-469c-8ab5-55f0f7779691]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:00 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 Jul 15 18:49:00 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Acquiring lock "cinder-26295dd2-60eb-4470-9d99-f0cfbeb45d85-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Lock "cinder-26295dd2-60eb-4470-9d99-f0cfbeb45d85-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Acquiring lock "cinder-quobyte-26295dd2-60eb-4470-9d99-f0cfbeb45d85" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Lock "cinder-quobyte-26295dd2-60eb-4470-9d99-f0cfbeb45d85" acquired by "delete_volume" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01accdd-d474-47a7-8a8a-ca08dcd13710]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:00 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6" returned: 0 in 0.433s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2937dae-4308-44e5-8f23-4e8e33f85bda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a733c9-f435-4de8-a514-e81bbb75974c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:00 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 Jul 15 18:49:00 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:01 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda Jul 15 18:49:01 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:01 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85" returned: 0 in 0.376s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:01 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 Jul 15 18:49:01 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:01 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda" returned: 0 in 0.443s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:01 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 Jul 15 18:49:01 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-08ef9c5b-7487-4fd5-b38e-c7780b5c0562-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-08ef9c5b-7487-4fd5-b38e-c7780b5c0562-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-quobyte-08ef9c5b-7487-4fd5-b38e-c7780b5c0562" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-08ef9c5b-7487-4fd5-b38e-c7780b5c0562" acquired by "delete_volume" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdceae5-1ae2-4352-bed9-d194e98f7fdd]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:01 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85" returned: 1 in 0.496s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:49:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:01 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85 Jul 15 18:49:01 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:01 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562 Jul 15 18:49:01 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:02 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26295dd2-60eb-4470-9d99-f0cfbeb45d85" returned: 0 in 0.420s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Lock "cinder-quobyte-26295dd2-60eb-4470-9d99-f0cfbeb45d85" released by "delete_volume" :: held 1.385s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Created reservations ['b335a14d-bd14-4567-a9d4-edb04a8aa593', 'feff69df-a716-44aa-b523-6bc6bf9479f8', '85cf8ad8-7226-4d1b-96a9-dc357335969f', 'dd5ed163-ac00-40bf-b9e4-500740ec9e72'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:02 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562" returned: 0 in 0.753s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:02 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562 Jul 15 18:49:02 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:02 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:02 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:02 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.494s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:03 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Deleted volume successfully. Jul 15 18:49:03 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-08ef9c5b-7487-4fd5-b38e-c7780b5c0562" returned: 0 in 0.731s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8656a436-9a82-4fab-8d61-2f502c7d58e4 tempest-VolumeAndVolumeTypeFromImageTest-1839526677 None] Lock "cinder-26295dd2-60eb-4470-9d99-f0cfbeb45d85-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-08ef9c5b-7487-4fd5-b38e-c7780b5c0562" released by "delete_volume" :: held 1.554s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Created reservations ['941a38f6-e146-4c89-81b0-3af73f421f54', 'a6a5526c-fce9-467a-a02e-e86bcca9adbf', 'e5e4278b-9946-41f1-93d3-eb52ef12506a', 'c64be55c-c7d9-4b70-9805-459b87bc170c'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:03 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:03 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-quobyte-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb" acquired by "delete_volume" :: waited 0.057s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:04 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[99417e32-c8c7-4380-bee7-b7e3e8ee8827]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:04 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.952s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:04 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:04 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Deleted volume successfully. Jul 15 18:49:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-76d278b1-55e3-4265-b309-ad90c94b7ade tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-08ef9c5b-7487-4fd5-b38e-c7780b5c0562-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:04 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb Jul 15 18:49:04 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:05 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb" returned: 0 in 1.307s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:05 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb Jul 15 18:49:05 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:06 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb" returned: 0 in 1.042s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb" released by "delete_volume" :: held 2.488s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:06 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Created reservations ['6470503a-3f77-4023-a081-caddc7f72ee3', 'f8eb588e-b6a0-4dde-ae0f-6c6517fadb60', 'ab0563d8-f31a-4eef-90a7-d27737a540e0', '58be68a6-aad6-4fd6-91bd-72e0db4569ac'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:07 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:07 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:07 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.354s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:07 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Deleted volume successfully. Jul 15 18:49:07 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8" returned: 0 in 6.157s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[80565de2-8ba6-4a8c-aa66-5cc33b52d509]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-26abb271-ab22-436c-8f44-a5b76d3d2fdd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-25d48a8c-9bb5-4ed3-af6c-2097bf8b67bb-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-39dae531-a8fe-49bd-9dc0-46408a443f2f-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-39dae531-a8fe-49bd-9dc0-46408a443f2f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-quobyte-39dae531-a8fe-49bd-9dc0-46408a443f2f" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:07 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda Jul 15 18:49:07 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-39dae531-a8fe-49bd-9dc0-46408a443f2f" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[53efe1d4-7607-4ecd-b89b-bd70b94dc430]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:07 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f Jul 15 18:49:07 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Flow 'volume_create_manager' (edb7ed0e-cda6-400a-866a-3bb39ce4d912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625b69e1-57b8-433a-91ee-622f65ab2934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625b69e1-57b8-433a-91ee-622f65ab2934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec31c54-c1f5-4673-8687-957b981af0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2846c75f5ec4bc6a2dd49d37870a9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:08Z,use_quota=True,user_id='9ac181fa7b844582abbea761203f15d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27df8ae-21c2-4376-8dc5-5b86e1aa1688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27df8ae-21c2-4376-8dc5-5b86e1aa1688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82c4d64-e6b6-475a-aa4f-4006d72a92a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.image.glance [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Creating Keystone auth plugin from conf {{(pid=87863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:49:08 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f" returned: 0 in 0.503s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:08 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f Jul 15 18:49:08 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:08 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda" returned: 0 in 0.789s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:49:08 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Converted 1024.00 MB image at 166.29 MB/s Jul 15 18:49:08 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 is being set with open permissions: ugo+rw Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:08 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 Jul 15 18:49:08 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:08 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-39dae531-a8fe-49bd-9dc0-46408a443f2f" returned: 0 in 0.318s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-39dae531-a8fe-49bd-9dc0-46408a443f2f" released by "delete_volume" :: held 0.896s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:08 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8" returned: 0 in 0.354s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-1b766a4a-3352-40c2-8264-d55dd46b38d8" released by "_copy_volume_from_snapshot" :: held 8.317s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6-1b766a4a-3352-40c2-8264-d55dd46b38d8" released by "_create_volume_from_snapshot" :: held 8.365s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.410s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Created reservations ['6c26e08a-f1d0-4e9d-b93d-7e33097457b5', '29ce622d-f143-4023-a149-bcb597cccbb3', '2a57f25f-84ae-4fcc-9f59-89c43438a1cc', 'a7a9df19-7cdc-4ec6-8282-feee9c66f6b2'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d66b14-ca5a-4a15-86e4-67729cfe8a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b766a4a-3352-40c2-8264-d55dd46b38d8', 'volume_size': 1, 'snapshot_id': '5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04264a8-679a-4052-8ed4-033d622227fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:08 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Volume volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 (1b766a4a-3352-40c2-8264-d55dd46b38d8): created successfully Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04264a8-679a-4052-8ed4-033d622227fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Flow 'volume_create_manager' (6bbcd563-e497-472a-ba78-08ed24f4c5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82c4d64-e6b6-475a-aa4f-4006d72a92a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aec31c54-c1f5-4673-8687-957b981af0a6', 'volume_name': 'volume-aec31c54-c1f5-4673-8687-957b981af0a6', 'volume_size': 1, 'image_id': 'b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53275c003b092184734fab078fcb665e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c2846c75f5ec4bc6a2dd49d37870a9ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '341c706059b5cd65e714844ab0225bb67fa920c9f908168697fecb30348d328aec544cab50ae16c0fe5e7085f1b2415d794dcb1e7606e90bd4d05410493f3bc1', 'id': 'b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'created_at': datetime.datetime(2026, 7, 15, 16, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 49, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29/file', 'properties': {}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f03baf6-0c7c-46f3-bc11-6441976b69a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f03baf6-0c7c-46f3-bc11-6441976b69a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8c5e8c-c4b3-4007-8fed-30d54539c946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:08 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Volume aec31c54-c1f5-4673-8687-957b981af0a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aec31c54-c1f5-4673-8687-957b981af0a6', 'volume_size': 1, 'image_id': 'b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53275c003b092184734fab078fcb665e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c2846c75f5ec4bc6a2dd49d37870a9ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '341c706059b5cd65e714844ab0225bb67fa920c9f908168697fecb30348d328aec544cab50ae16c0fe5e7085f1b2415d794dcb1e7606e90bd4d05410493f3bc1', 'id': 'b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'created_at': datetime.datetime(2026, 7, 15, 16, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 49, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29/file', 'properties': {}}, 'image_service': } Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Trying to clone aec31c54-c1f5-4673-8687-957b981af0a6 from image b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'metadata': {}}]). {{(pid=87863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:49:08 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-44c38793-5743-4dcb-9eb7-99ec58aa6666 tempest-VolumeDependencyTests-1080159501 None] Created volume successfully. Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:08 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:49:08 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Image download 0.00 MB at 0.00 MB/s Jul 15 18:49:08 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:08 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcb3f66-03e6-4a9e-aec0-8eefb490e434]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:09 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD Jul 15 18:49:09 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:09 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.327s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:09 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Deleted volume successfully. Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d0061747-4962-4f20-ae8e-bfc6fabec6cd tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-39dae531-a8fe-49bd-9dc0-46408a443f2f-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:09 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:09 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD Jul 15 18:49:09 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "cinder-5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "cinder-quobyte-b2937dae-4308-44e5-8f23-4e8e33f85bda" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-b2937dae-4308-44e5-8f23-4e8e33f85bda" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "cinder-quobyte-5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:09 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Temporary image b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29 is fetched for user 9ac181fa7b844582abbea761203f15d0. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Deleting offline snapshot 5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 of volume b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] snapshot_file for this snap is: volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac8252d-f9ff-4454-b70b-3e37cbd6c545]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-8304542f-e337-4274-8951-f7c269a6ec73-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0608f33-c940-4416-b57b-e887c4897630]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:09 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-8304542f-e337-4274-8951-f7c269a6ec73-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:09 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 Jul 15 18:49:09 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-quobyte-8304542f-e337-4274-8951-f7c269a6ec73" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-8304542f-e337-4274-8951-f7c269a6ec73" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:10 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD Jul 15 18:49:10 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b72a14-34a0-4e0d-b28b-59e1b01aefae]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:10 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73 Jul 15 18:49:10 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:10 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6" returned: 0 in 0.442s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2937dae-4308-44e5-8f23-4e8e33f85bda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:10 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c634892-7516-410b-9223-85b11c3babc1]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:10 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD Jul 15 18:49:10 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:10 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda Jul 15 18:49:10 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:10 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73" returned: 0 in 0.459s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:10 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73 Jul 15 18:49:10 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:10 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec31c54-c1f5-4673-8687-957b981af0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2846c75f5ec4bc6a2dd49d37870a9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:08Z,use_quota=True,user_id='9ac181fa7b844582abbea761203f15d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Creating volume aec31c54-c1f5-4673-8687-957b981af0a6 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:10 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:10 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda" returned: 0 in 0.439s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:10 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 1073741824 Jul 15 18:49:10 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:10 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 Jul 15 18:49:10 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:10 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8304542f-e337-4274-8951-f7c269a6ec73" returned: 0 in 0.363s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-8304542f-e337-4274-8951-f7c269a6ec73" released by "delete_volume" :: held 0.879s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Created reservations ['0914a5bb-4f43-4c07-87be-40e397a22ce0', '578dd2bb-a2d8-45eb-ae9a-70d606918b6d', '67bd6653-8afe-4cc8-a9a8-36aa50939e36', '039628dc-06b4-4471-8e16-7251b32f28ba'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:11 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:11 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:11 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6" returned: 0 in 0.463s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:11 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6 Jul 15 18:49:11 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:11 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 1073741824" returned: 0 in 0.550s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:11 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 Jul 15 18:49:11 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:11 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.385s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:11 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Deleted volume successfully. Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-af5f7967-4089-4765-a179-aae94b888569 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-8304542f-e337-4274-8951-f7c269a6ec73-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:11 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda.5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6" returned: 0 in 0.316s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6" released by "_delete_snapshot" :: held 1.813s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:11 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-b2937dae-4308-44e5-8f23-4e8e33f85bda" released by "delete_snapshot" :: held 1.869s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (f750547c-f33f-43b2-8f9e-17c4673ecb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ac7f63-0ecc-4ebb-b805-4c8f24e1f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ac7f63-0ecc-4ebb-b805-4c8f24e1f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1772011423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7fc5126-587d-4b01-bab0-8406db4275b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:12Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd97a08-d46e-4ba4-9ccf-a59aa480c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd97a08-d46e-4ba4-9ccf-a59aa480c66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67faf08c-7b20-49b0-aaf5-eae0b7f00989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67faf08c-7b20-49b0-aaf5-eae0b7f00989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7fc5126-587d-4b01-bab0-8406db4275b0', 'volume_name': 'volume-d7fc5126-587d-4b01-bab0-8406db4275b0', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca8c65e-2135-4660-a91b-3aaeb9491823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca8c65e-2135-4660-a91b-3aaeb9491823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c314a78-31e8-4187-a874-3160b61f9f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:11 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume d7fc5126-587d-4b01-bab0-8406db4275b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7fc5126-587d-4b01-bab0-8406db4275b0', 'volume_size': 1} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1772011423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7fc5126-587d-4b01-bab0-8406db4275b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:12Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Creating volume d7fc5126-587d-4b01-bab0-8406db4275b0 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:11 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Attempting download of b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'metadata': {}}])) to volume aec31c54-c1f5-4673-8687-957b981af0a6. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:49:11 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0 1073741824 Jul 15 18:49:11 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Created reservations ['6767d071-fd1d-4ddb-9d7e-32b1b3a1da7d', 'cac4c83e-4a3d-420a-8a50-1f2299ea0c2c', '3abb5585-74fe-4646-b0e7-efb319d25669', 'af46fea5-a0c3-4474-8cc4-8924dc4217a0'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b8b919-6445-4cfe-85d7-26d3604d84b6]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_gzr4vkoe {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:11 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Delete snapshot completed successfully. Jul 15 18:49:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-28249fae-cd79-40ff-a07f-4c7e4c489b65 tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-5ab75c82-0ec1-4fdd-a1d3-47bee5bf63b6-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:11 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_gzr4vkoe Jul 15 18:49:11 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-513918b2-1ccf-4060-bd96-c15c51b41a3d-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-513918b2-1ccf-4060-bd96-c15c51b41a3d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:12 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_gzr4vkoe" returned: 0 in 0.399s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_gzr4vkoe {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-quobyte-513918b2-1ccf-4060-bd96-c15c51b41a3d" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-513918b2-1ccf-4060-bd96-c15c51b41a3d" acquired by "delete_volume" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:12 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0 1073741824" returned: 0 in 0.539s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a548a9b-119f-4508-87f7-fd7ee31d28db]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:12 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0 Jul 15 18:49:12 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:12 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_gzr4vkoe Jul 15 18:49:12 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:12 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d Jul 15 18:49:12 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:12 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0" returned: 0 in 0.249s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:12 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c314a78-31e8-4187-a874-3160b61f9f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7fc5126-587d-4b01-bab0-8406db4275b0', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a08c90d-e805-468e-ab9c-f2554ec0659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_gzr4vkoe" returned: 1 in 0.385s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_gzr4vkoe' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e20b14e-f8fb-4166-874e-8e60e093dc38]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:12 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume volume-d7fc5126-587d-4b01-bab0-8406db4275b0 (d7fc5126-587d-4b01-bab0-8406db4275b0): created successfully Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a08c90d-e805-468e-ab9c-f2554ec0659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (f750547c-f33f-43b2-8f9e-17c4673ecb2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:12 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-92ff8688-057d-41d4-b6f1-0861eb93310f tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created volume successfully. Jul 15 18:49:12 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d" returned: 0 in 0.406s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:12 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD Jul 15 18:49:12 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:12 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d Jul 15 18:49:12 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:12 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "cinder-b2937dae-4308-44e5-8f23-4e8e33f85bda-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:12 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-b2937dae-4308-44e5-8f23-4e8e33f85bda-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-513918b2-1ccf-4060-bd96-c15c51b41a3d" returned: 0 in 0.276s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-513918b2-1ccf-4060-bd96-c15c51b41a3d" released by "delete_volume" :: held 0.742s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "cinder-quobyte-b2937dae-4308-44e5-8f23-4e8e33f85bda" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-b2937dae-4308-44e5-8f23-4e8e33f85bda" acquired by "delete_volume" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:13 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD Jul 15 18:49:13 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Created reservations ['1d107b90-ddbe-450a-95d8-eb135c630d50', 'd24b69fe-0791-48c1-b46b-5a167a0f520b', '25532e6e-2e77-4b18-ac11-0bc2b5d91ef1', '08e969ec-32c0-4f39-980c-dc4e3d81b636'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[38addba6-811f-45fd-85ed-e0ca859880c4]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:13 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:13 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:13 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda Jul 15 18:49:13 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:13 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29 was raw, converting to raw {{(pid=87863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:13 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 Jul 15 18:49:13 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-e9d498ac-d4c0-4a3a-a25c-963b0415546e-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-e9d498ac-d4c0-4a3a-a25c-963b0415546e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-quobyte-f45dfaf6-67ff-4c7b-9541-0796600486f9" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-f45dfaf6-67ff-4c7b-9541-0796600486f9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-quobyte-e9d498ac-d4c0-4a3a-a25c-963b0415546e" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-e9d498ac-d4c0-4a3a-a25c-963b0415546e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Deleting offline snapshot e9d498ac-d4c0-4a3a-a25c-963b0415546e of volume f45dfaf6-67ff-4c7b-9541-0796600486f9 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:13 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] snapshot_file for this snap is: volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.309s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[df111efc-6141-4d72-a52e-e4f7d7a00a07]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:13 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Deleted volume successfully. Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-260f4998-b033-46e7-aad8-860ed4500c99 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-513918b2-1ccf-4060-bd96-c15c51b41a3d-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:13 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda" returned: 0 in 0.466s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:13 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda Jul 15 18:49:13 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:13 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e Jul 15 18:49:13 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:13 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6" returned: 0 in 0.437s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29_ooxzia9wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:49:13 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Converted 0.00 MB image at 0.00 MB/s Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:13 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 1G Jul 15 18:49:13 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:13 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b2937dae-4308-44e5-8f23-4e8e33f85bda" returned: 0 in 0.290s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-b2937dae-4308-44e5-8f23-4e8e33f85bda" released by "delete_volume" :: held 0.828s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:13 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e" returned: 0 in 0.453s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f45dfaf6-67ff-4c7b-9541-0796600486f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Created reservations ['e34730f0-40af-4324-9fa8-0d4c752b3027', '52e2634f-0b02-4d19-8691-7601653533c2', '778a72bf-6a16-41cd-a9e2-bc5f17770f10', '3a51aaed-b7e4-413f-8fbd-00d76166e99e'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b678bc87-46b0-4531-95cc-d7435482ada9]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:14 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:14 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 Jul 15 18:49:14 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 1G" returned: 0 in 0.415s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9c4410-787a-4ba6-b466-06c79edb2877]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:14 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 Jul 15 18:49:14 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (e9bd4e03-239e-4720-bb3f-b72bc42cc224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8caf95-bd7f-455b-9c3b-0c82f9273159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:14 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9" returned: 0 in 0.507s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8caf95-bd7f-455b-9c3b-0c82f9273159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678624570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6320cc5-04bd-4078-a191-169a71eb7572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:14Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33100f9-d89f-48a7-a661-08db9c1e9d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33100f9-d89f-48a7-a661-08db9c1e9d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77a1d3f-8e9f-4c44-81b9-938246744505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77a1d3f-8e9f-4c44-81b9-938246744505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6320cc5-04bd-4078-a191-169a71eb7572', 'volume_name': 'volume-c6320cc5-04bd-4078-a191-169a71eb7572', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ef2952-e593-42eb-8643-b1e777e850d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:14 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e Jul 15 18:49:14 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ef2952-e593-42eb-8643-b1e777e850d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6cdca5-4ca5-43f4-b9a7-d675debcfdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:14 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume c6320cc5-04bd-4078-a191-169a71eb7572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6320cc5-04bd-4078-a191-169a71eb7572', 'volume_size': 1} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678624570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6320cc5-04bd-4078-a191-169a71eb7572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:14Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Creating volume c6320cc5-04bd-4078-a191-169a71eb7572 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:14 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.477s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:14 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Deleted volume successfully. Jul 15 18:49:14 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572 1073741824 Jul 15 18:49:14 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-828dd9a9-81eb-4cb6-bdb0-7a405239270f tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-b2937dae-4308-44e5-8f23-4e8e33f85bda-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:14 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (147e604d-6002-4990-b24f-b695866711f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ac5644-8acc-41b8-9a3b-88497c7f5f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6" returned: 0 in 0.644s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ac5644-8acc-41b8-9a3b-88497c7f5f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-94013892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0075aaec-da2b-45e9-ada5-097317a2f246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:15Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7572a91f-615b-4fad-abc6-658cf4a2a3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7572a91f-615b-4fad-abc6-658cf4a2a3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10c4c96-1d84-4906-b7e4-9ede371464a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10c4c96-1d84-4906-b7e4-9ede371464a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0075aaec-da2b-45e9-ada5-097317a2f246', 'volume_name': 'volume-0075aaec-da2b-45e9-ada5-097317a2f246', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ed1353-34a6-4ce0-9780-8dcccce4cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:14 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ed1353-34a6-4ce0-9780-8dcccce4cb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5227c662-ce90-4a11-bbf6-58c705eda7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume 0075aaec-da2b-45e9-ada5-097317a2f246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0075aaec-da2b-45e9-ada5-097317a2f246', 'volume_size': 1} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:15 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 Jul 15 18:49:15 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:15 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e" returned: 0 in 0.618s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:15 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e Jul 15 18:49:15 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "cinder-1b766a4a-3352-40c2-8264-d55dd46b38d8-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:15 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (38f85943-ca7c-4fb0-bafe-850597f18800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998772b8-f0c0-41e5-9c46-3f2d97b109c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-1b766a4a-3352-40c2-8264-d55dd46b38d8-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572 1073741824" returned: 0 in 0.781s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998772b8-f0c0-41e5-9c46-3f2d97b109c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1101986990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dedf626e-ebb6-49fb-8419-de6daffcabbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:15Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569392b1-7687-45c1-8966-08d81e69440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569392b1-7687-45c1-8966-08d81e69440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5b843d-9751-40a4-a1f8-4d4f5d914986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5b843d-9751-40a4-a1f8-4d4f5d914986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dedf626e-ebb6-49fb-8419-de6daffcabbf', 'volume_name': 'volume-dedf626e-ebb6-49fb-8419-de6daffcabbf', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9496c2-d872-4a7d-8897-4bde7e3b7805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9496c2-d872-4a7d-8897-4bde7e3b7805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0262c1bd-d67b-43f2-8174-156e18a70748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume dedf626e-ebb6-49fb-8419-de6daffcabbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dedf626e-ebb6-49fb-8419-de6daffcabbf', 'volume_size': 1} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6" returned: 1 in 0.566s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Downloaded image b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'metadata': {}}])) to volume aec31c54-c1f5-4673-8687-957b981af0a6 successfully. {{(pid=87863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Temporary image b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29 for user 9ac181fa7b844582abbea761203f15d0 is deleted. {{(pid=87863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.volume_utils [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Marking volume aec31c54-c1f5-4673-8687-957b981af0a6 as bootable. {{(pid=87863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Copying metadata from image b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29 to aec31c54-c1f5-4673-8687-957b981af0a6. {{(pid=87863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Creating volume glance metadata for volume aec31c54-c1f5-4673-8687-957b981af0a6 backed by image b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29 with: {'image_id': 'b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '53275c003b092184734fab078fcb665e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "cinder-quobyte-1b766a4a-3352-40c2-8264-d55dd46b38d8" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-1b766a4a-3352-40c2-8264-d55dd46b38d8" acquired by "delete_volume" :: waited 0.037s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:15 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572 Jul 15 18:49:15 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1449fad3-bd42-45fb-9fc3-56676969ef13]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8c5e8c-c4b3-4007-8fed-30d54539c946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec31c54-c1f5-4673-8687-957b981af0a6', 'volume_size': 1, 'image_id': 'b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53275c003b092184734fab078fcb665e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c2846c75f5ec4bc6a2dd49d37870a9ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '341c706059b5cd65e714844ab0225bb67fa920c9f908168697fecb30348d328aec544cab50ae16c0fe5e7085f1b2415d794dcb1e7606e90bd4d05410493f3bc1', 'id': 'b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29', 'created_at': datetime.datetime(2026, 7, 15, 16, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 49, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6ed4c0e-8dd3-4311-bcec-4c6589a7cf29/file', 'properties': {}}, 'image_service': }' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47abd3c-3054-42b9-958c-75d946e1e99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9.e9d498ac-d4c0-4a3a-a25c-963b0415546e" returned: 0 in 0.582s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:15 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Volume volume-aec31c54-c1f5-4673-8687-957b981af0a6 (aec31c54-c1f5-4673-8687-957b981af0a6): created successfully Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47abd3c-3054-42b9-958c-75d946e1e99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Flow 'volume_create_manager' (edb7ed0e-cda6-400a-866a-3bb39ce4d912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:15 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 Jul 15 18:49:15 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-e9d498ac-d4c0-4a3a-a25c-963b0415546e" released by "_delete_snapshot" :: held 2.371s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:15 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f70d1da8-85a9-486e-a980-f79fec7058ab tempest-VolumeImageDependencyTests-1950458194 None] Created volume successfully. Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (8b851388-316f-420d-8a40-c719935a14b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857605c8-7545-45d6-97f6-2cd736cedb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-f45dfaf6-67ff-4c7b-9541-0796600486f9" released by "delete_snapshot" :: held 2.478s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:15 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572" returned: 0 in 0.463s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-94013892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0075aaec-da2b-45e9-ada5-097317a2f246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:15Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Creating volume 0075aaec-da2b-45e9-ada5-097317a2f246 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:15 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857605c8-7545-45d6-97f6-2cd736cedb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-147356617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e36be2-9713-49f2-9d7c-0ab96cdaca0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:16Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246 1073741824 Jul 15 18:49:16 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbbd73d-d06c-436e-a1d5-a68ee16dabd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbbd73d-d06c-436e-a1d5-a68ee16dabd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6c58d0-4861-494e-b8ec-cdcd6670ed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6c58d0-4861-494e-b8ec-cdcd6670ed31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e36be2-9713-49f2-9d7c-0ab96cdaca0d', 'volume_name': 'volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9468550d-f2c8-4cad-8355-1ea7f4da2093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9468550d-f2c8-4cad-8355-1ea7f4da2093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676d61fe-0924-42f7-893e-b8c7d22fdb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume 80e36be2-9713-49f2-9d7c-0ab96cdaca0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d', 'volume_size': 1} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6cdca5-4ca5-43f4-b9a7-d675debcfdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6320cc5-04bd-4078-a191-169a71eb7572', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f385b5c2-8eb3-4771-b266-0371b4c6c1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume volume-c6320cc5-04bd-4078-a191-169a71eb7572 (c6320cc5-04bd-4078-a191-169a71eb7572): created successfully Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f385b5c2-8eb3-4771-b266-0371b4c6c1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (e9bd4e03-239e-4720-bb3f-b72bc42cc224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:16 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2305a96e-0bde-4d16-8aa6-96ccf95532f9 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created volume successfully. Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:16 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (b5fb99c7-8c41-40c6-a508-ebb9f2cb2d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd8be7f-520c-4b7d-90c7-0737390a03d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Created reservations ['9c13acff-3d34-4612-bc29-70fff56d47f7', 'dd2ccc9c-3a2a-43c6-bb83-2077f04f5fa9', 'a072c9c9-6c65-4cce-a317-47b6cac466f7', '05e97d34-5800-4a6d-aa36-4dd0506fff95'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8" returned: 0 in 0.613s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd8be7f-520c-4b7d-90c7-0737390a03d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998983151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdf9348-7ec5-4ea7-8b78-849a46c10030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:16Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8 Jul 15 18:49:16 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7af1e87-7f86-4eb0-a054-1f1d62c3bc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7af1e87-7f86-4eb0-a054-1f1d62c3bc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e37d41-1799-45a9-b3cc-80d6b62a39b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e37d41-1799-45a9-b3cc-80d6b62a39b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bdf9348-7ec5-4ea7-8b78-849a46c10030', 'volume_name': 'volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946e06c5-7f58-4156-a46d-ca79f827f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946e06c5-7f58-4156-a46d-ca79f827f47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f83071-615e-493e-9ff0-3ba199960cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume 9bdf9348-7ec5-4ea7-8b78-849a46c10030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030', 'volume_size': 1} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:16 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Delete snapshot completed successfully. Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ca6967ab-c15b-49fe-b420-83e7f9a8b9a9 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-e9d498ac-d4c0-4a3a-a25c-963b0415546e-delete_snapshot" released by "delete_snapshot" :: held 2.861s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:16 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246 1073741824" returned: 0 in 0.473s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:16 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-1b766a4a-3352-40c2-8264-d55dd46b38d8" returned: 0 in 0.298s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-quobyte-1b766a4a-3352-40c2-8264-d55dd46b38d8" released by "delete_volume" :: held 0.966s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:16 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246 Jul 15 18:49:16 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Created reservations ['ba3f2852-1da2-4d4d-99ed-08f18fe88458', 'bb9c7691-83b2-4eca-9d42-b32786344c41', '7121a568-fef9-440b-b338-9fe0d32df2af', '9a636ff1-767a-4044-ba07-d8694e952a90'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:16 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:16 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-f45dfaf6-67ff-4c7b-9541-0796600486f9-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-f45dfaf6-67ff-4c7b-9541-0796600486f9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "cinder-quobyte-f45dfaf6-67ff-4c7b-9541-0796600486f9" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:16 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246" returned: 0 in 0.290s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.329s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1101986990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dedf626e-ebb6-49fb-8419-de6daffcabbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:15Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Creating volume dedf626e-ebb6-49fb-8419-de6daffcabbf {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:16 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-f45dfaf6-67ff-4c7b-9541-0796600486f9" acquired by "delete_volume" :: waited 0.056s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:16 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf 1073741824 Jul 15 18:49:16 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5227c662-ce90-4a11-bbf6-58c705eda7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0075aaec-da2b-45e9-ada5-097317a2f246', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f083954-73c0-4ba3-bd10-8ecfd96a4346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b1ed81-c346-4885-8152-3ef8ae777bba]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:16 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume volume-0075aaec-da2b-45e9-ada5-097317a2f246 (0075aaec-da2b-45e9-ada5-097317a2f246): created successfully Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f083954-73c0-4ba3-bd10-8ecfd96a4346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (147e604d-6002-4990-b24f-b695866711f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:16 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.318s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:16 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-eaccebcf-0922-45b3-b551-8a265a2c8f7c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created volume successfully. Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:16 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Deleted volume successfully. Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Acquiring lock "cinder-aec31c54-c1f5-4673-8687-957b981af0a6-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d5409766-0ab1-4a5e-a3a7-46df7517732f tempest-VolumeDependencyTests-1080159501 None] Lock "cinder-1b766a4a-3352-40c2-8264-d55dd46b38d8-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Lock "cinder-aec31c54-c1f5-4673-8687-957b981af0a6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:17 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 Jul 15 18:49:17 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Acquiring lock "cinder-quobyte-aec31c54-c1f5-4673-8687-957b981af0a6" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Lock "cinder-quobyte-aec31c54-c1f5-4673-8687-957b981af0a6" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd6689d-d595-4e23-87ea-2cb372a2c3a3]: (4, 'raw') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:17 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 Jul 15 18:49:17 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:17 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf 1073741824" returned: 0 in 0.551s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:17 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9" returned: 0 in 0.476s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:17 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9 Jul 15 18:49:17 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:17 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf Jul 15 18:49:17 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:17 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6" returned: 0 in 0.411s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:17 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-f45dfaf6-67ff-4c7b-9541-0796600486f9" returned: 0 in 0.275s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-quobyte-f45dfaf6-67ff-4c7b-9541-0796600486f9" released by "delete_volume" :: held 0.845s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:17 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf" returned: 0 in 0.290s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.656s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-147356617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e36be2-9713-49f2-9d7c-0ab96cdaca0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:16Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Creating volume 80e36be2-9713-49f2-9d7c-0ab96cdaca0d {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:17 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 Jul 15 18:49:17 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:17 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:17 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d 1073741824 Jul 15 18:49:17 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0262c1bd-d67b-43f2-8174-156e18a70748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dedf626e-ebb6-49fb-8419-de6daffcabbf', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a171b5-3533-44a8-9961-978adae05acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:17 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume volume-dedf626e-ebb6-49fb-8419-de6daffcabbf (dedf626e-ebb6-49fb-8419-de6daffcabbf): created successfully Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a171b5-3533-44a8-9961-978adae05acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (38f85943-ca7c-4fb0-bafe-850597f18800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:17 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7047a2c8-f5a0-4b87-a7f5-2ccf5509b635 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created volume successfully. Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Created reservations ['9736dcc0-a393-44d0-b733-da2ca95a911c', 'e356c8da-f857-46ea-9b26-b04c3ccab091', '05f73ae4-b9dc-4a5d-9a14-ce2ffa7fb4d7', '7b4e0130-532b-480f-a145-75b3f185d462'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:17 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:18 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:18 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:18 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6" returned: 1 in 0.535s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6' failed. Not Retrying. {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:18 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6 Jul 15 18:49:18 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:18 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d 1073741824" returned: 0 in 0.651s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:18 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.357s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:18 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Deleted volume successfully. Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-feabadd1-931b-4621-b0e3-d1abe3704491 tempest-CreateVolumesFromSnapshotTest-702727735 None] Lock "cinder-f45dfaf6-67ff-4c7b-9541-0796600486f9-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:18 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-aec31c54-c1f5-4673-8687-957b981af0a6" returned: 0 in 0.341s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:18 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d Jul 15 18:49:18 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Lock "cinder-quobyte-aec31c54-c1f5-4673-8687-957b981af0a6" released by "delete_volume" :: held 1.371s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Created reservations ['d2255645-328e-4608-a11e-dbff8ab43c16', 'f9c206da-3d07-4aaf-8ddc-2ccdb2368bc7', '8a099d2e-17ab-4d5e-bb48-7254391ade7d', '67ab73f2-9b7d-4320-8ad9-36514d98bbd4'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:18 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:18 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:18 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d" returned: 0 in 0.271s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.470s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998983151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdf9348-7ec5-4ea7-8b78-849a46c10030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c2be0a237645db8271a99d65fc35bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:16Z,use_quota=True,user_id='14644d6734f04088aac6a27ffaac75c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Creating volume 9bdf9348-7ec5-4ea7-8b78-849a46c10030 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:18 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:18 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030 1073741824 Jul 15 18:49:18 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676d61fe-0924-42f7-893e-b8c7d22fdb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a65feb-f9ba-441f-8010-81f5e08003a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:18 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d (80e36be2-9713-49f2-9d7c-0ab96cdaca0d): created successfully Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a65feb-f9ba-441f-8010-81f5e08003a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (8b851388-316f-420d-8a40-c719935a14b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:18 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-29213de9-d765-44b7-8620-2c2b7ea3b940 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created volume successfully. Jul 15 18:49:18 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.298s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:18 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Deleted volume successfully. Jul 15 18:49:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36fd919e-e291-455b-b2b5-3e10a22f1979 tempest-VolumeImageDependencyTests-1950458194 None] Lock "cinder-aec31c54-c1f5-4673-8687-957b981af0a6-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:19 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030 1073741824" returned: 0 in 0.571s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:19 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030 Jul 15 18:49:19 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:19 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030" returned: 0 in 0.320s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f83071-615e-493e-9ff0-3ba199960cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2228eec4-0413-4d34-a501-1fed62e9e159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Volume volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030 (9bdf9348-7ec5-4ea7-8b78-849a46c10030): created successfully Jul 15 18:49:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2228eec4-0413-4d34-a501-1fed62e9e159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:19 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Flow 'volume_create_manager' (b5fb99c7-8c41-40c6-a508-ebb9f2cb2d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:19 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6fa7d357-24d6-417b-9247-50919a4576c5 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created volume successfully. Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-9bdf9348-7ec5-4ea7-8b78-849a46c10030-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-9bdf9348-7ec5-4ea7-8b78-849a46c10030-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-quobyte-9bdf9348-7ec5-4ea7-8b78-849a46c10030" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-9bdf9348-7ec5-4ea7-8b78-849a46c10030" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6579cfd3-b999-49ba-9895-f1e06067a344]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:21 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030 Jul 15 18:49:21 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:21 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030" returned: 0 in 0.409s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:21 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030 Jul 15 18:49:21 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:21 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9bdf9348-7ec5-4ea7-8b78-849a46c10030" returned: 0 in 0.280s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-9bdf9348-7ec5-4ea7-8b78-849a46c10030" released by "delete_volume" :: held 0.742s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:21 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created reservations ['49d5d24c-fa63-4cb6-a059-d7b1d21b5268', '45ad59e8-4681-4687-bd38-322656c9e559', '71fac9aa-437a-42fc-8329-c9534be9ebaf', '230d3594-a0d1-46b6-9f8b-4e2ea3c49fc1'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:22 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:22 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:22 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-80e36be2-9713-49f2-9d7c-0ab96cdaca0d-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.285s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:22 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Deleted volume successfully. Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-80e36be2-9713-49f2-9d7c-0ab96cdaca0d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ea364675-5295-4f2c-a6e3-a00812a6c402 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-9bdf9348-7ec5-4ea7-8b78-849a46c10030-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-quobyte-80e36be2-9713-49f2-9d7c-0ab96cdaca0d" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-80e36be2-9713-49f2-9d7c-0ab96cdaca0d" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cba927-3863-4502-a9dd-44f15a8cf0d3]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:22 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d Jul 15 18:49:22 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:22 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d" returned: 0 in 0.514s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:22 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d Jul 15 18:49:22 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:23 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-80e36be2-9713-49f2-9d7c-0ab96cdaca0d" returned: 0 in 0.366s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Flow 'volume_create_manager' (f66887bb-3629-4d9d-b962-89ff6ada902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83eeb9f-cb47-44d4-b5f8-facb9992764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-80e36be2-9713-49f2-9d7c-0ab96cdaca0d" released by "delete_volume" :: held 0.974s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83eeb9f-cb47-44d4-b5f8-facb9992764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3048f5e6-0627-4428-aeaa-f3eb4bd7d319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00da8dd0386a468c8b953614867b0013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:23Z,use_quota=True,user_id='aace92eca4ac42a8a5884f725d0ca8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b533a2d-aedd-4fb6-a8e6-860d8ac8f363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b533a2d-aedd-4fb6-a8e6-860d8ac8f363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c89445-e848-4d34-b653-3fc920e73a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c89445-e848-4d34-b653-3fc920e73a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3048f5e6-0627-4428-aeaa-f3eb4bd7d319', 'volume_name': 'volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16cfb60-076a-4b2c-8775-941916262423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16cfb60-076a-4b2c-8775-941916262423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ff2b49-f56c-4137-83f0-e7d24645b4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:23 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Volume 3048f5e6-0627-4428-aeaa-f3eb4bd7d319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319', 'volume_size': 1} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3048f5e6-0627-4428-aeaa-f3eb4bd7d319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00da8dd0386a468c8b953614867b0013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:23Z,use_quota=True,user_id='aace92eca4ac42a8a5884f725d0ca8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Creating volume 3048f5e6-0627-4428-aeaa-f3eb4bd7d319 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:23 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:23 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319 1073741824 Jul 15 18:49:23 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created reservations ['62d6aef0-7f3a-4e37-8c38-7041f5ac62ba', '7f1384dd-9710-4834-b938-73af873320dd', 'dfebd574-89a5-4397-8a13-5360e0508c54', 'cf227217-8414-4600-ba81-73a7305b5083'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:23 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:23 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:23 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.316s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:23 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Deleted volume successfully. Jul 15 18:49:23 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2685f2c2-489e-436e-9381-d3c3bbfdc2b0 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-80e36be2-9713-49f2-9d7c-0ab96cdaca0d-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:24 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319 1073741824" returned: 0 in 0.619s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2b170322-50b6-4a5e-8ff8-cfb862dc1cd9 tempest-ProjectAdminTests-1530071328 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6894493103027, 'free_capacity_gb': 1775.6894493103027, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:24 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319 Jul 15 18:49:24 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:24 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ff2b49-f56c-4137-83f0-e7d24645b4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969d73e9-7024-4bbe-9ac0-e0a8b8fdb2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:24 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Volume volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319 (3048f5e6-0627-4428-aeaa-f3eb4bd7d319): created successfully Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969d73e9-7024-4bbe-9ac0-e0a8b8fdb2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Flow 'volume_create_manager' (f66887bb-3629-4d9d-b962-89ff6ada902b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:24 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-85978967-3f6c-4bd5-b5d1-855c911a29b8 tempest-CinderUnicodeTest-2014760125 None] Created volume successfully. Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-dedf626e-ebb6-49fb-8419-de6daffcabbf-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-dedf626e-ebb6-49fb-8419-de6daffcabbf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-quobyte-dedf626e-ebb6-49fb-8419-de6daffcabbf" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-dedf626e-ebb6-49fb-8419-de6daffcabbf" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eda7e3-7bc0-4da9-b06c-52f5a4074a7e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:24 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf Jul 15 18:49:24 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:25 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf" returned: 0 in 0.464s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:25 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf Jul 15 18:49:25 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:25 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-dedf626e-ebb6-49fb-8419-de6daffcabbf" returned: 0 in 0.323s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-dedf626e-ebb6-49fb-8419-de6daffcabbf" released by "delete_volume" :: held 0.844s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created reservations ['a8d96427-6175-431b-a0d0-c45236877717', '988bcf56-fb37-4a17-a1a8-11c0f9a80df5', '678d5532-9b47-4bf2-93fa-bd9d23775509', '50391919-884f-49f4-8082-f2d761d72308'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:25 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:25 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-0075aaec-da2b-45e9-ada5-097317a2f246-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-0075aaec-da2b-45e9-ada5-097317a2f246-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-quobyte-0075aaec-da2b-45e9-ada5-097317a2f246" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-0075aaec-da2b-45e9-ada5-097317a2f246" acquired by "delete_volume" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c80078e-ddff-4310-b113-cb1a485aba7b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Flow 'volume_create_manager' (52966dfa-9e8c-4462-805e-1e48e4f21350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac700719-237e-4620-884b-9cd14947aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac700719-237e-4620-884b-9cd14947aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1950935761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d6b9f2-9e57-4731-bb33-3be127eeaa41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00da8dd0386a468c8b953614867b0013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:26Z,use_quota=True,user_id='aace92eca4ac42a8a5884f725d0ca8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f729c07b-8a06-4777-b7c4-d8591953e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f729c07b-8a06-4777-b7c4-d8591953e62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:26 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246 Jul 15 18:49:26 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f97cdc9-6113-4440-a362-ad667edc3922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f97cdc9-6113-4440-a362-ad667edc3922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3d6b9f2-9e57-4731-bb33-3be127eeaa41', 'volume_name': 'volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f2fbd2-ac8f-4f6f-a6d3-6931b92a1167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f2fbd2-ac8f-4f6f-a6d3-6931b92a1167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c8de40-517d-4d35-b6b2-a6b3093bdd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:26 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Volume d3d6b9f2-9e57-4731-bb33-3be127eeaa41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41', 'volume_size': 1} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:26 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1950935761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d6b9f2-9e57-4731-bb33-3be127eeaa41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00da8dd0386a468c8b953614867b0013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:26Z,use_quota=True,user_id='aace92eca4ac42a8a5884f725d0ca8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Creating volume d3d6b9f2-9e57-4731-bb33-3be127eeaa41 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:26 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.547s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:26 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Deleted volume successfully. Jul 15 18:49:26 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 1073741824 Jul 15 18:49:26 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-680c9e4e-2863-459d-b080-f6094a0daa2e tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-dedf626e-ebb6-49fb-8419-de6daffcabbf-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:26 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246" returned: 0 in 0.449s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:26 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246 Jul 15 18:49:26 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:26 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-0075aaec-da2b-45e9-ada5-097317a2f246" returned: 0 in 0.316s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-0075aaec-da2b-45e9-ada5-097317a2f246" released by "delete_volume" :: held 0.840s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created reservations ['21e2aa81-96f0-4b33-9027-eaa91377d902', '2b8119df-9751-49ad-9c17-8643afdd2629', '127a785c-9574-4a0b-a763-a381cc1f21ec', '59576bbc-bacb-4b0b-9dd0-b675a5aab8c6'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:26 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 1073741824" returned: 0 in 0.687s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:27 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 Jul 15 18:49:27 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:27 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:27 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-c6320cc5-04bd-4078-a191-169a71eb7572-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-c6320cc5-04bd-4078-a191-169a71eb7572-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-quobyte-c6320cc5-04bd-4078-a191-169a71eb7572" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-c6320cc5-04bd-4078-a191-169a71eb7572" acquired by "delete_volume" :: waited 0.025s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[04144db4-5acb-4771-8da6-f24f9dbddfcc]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:27 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.333s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Deleted volume successfully. Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-0544cbb3-a8e7-45cd-a622-28adfd3ed45d tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-0075aaec-da2b-45e9-ada5-097317a2f246-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:27 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572 Jul 15 18:49:27 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:27 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" returned: 0 in 0.476s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c8de40-517d-4d35-b6b2-a6b3093bdd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8637d2-3ad6-408d-a635-4e0c3ee3cd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:27 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Volume volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 (d3d6b9f2-9e57-4731-bb33-3be127eeaa41): created successfully Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8637d2-3ad6-408d-a635-4e0c3ee3cd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Flow 'volume_create_manager' (52966dfa-9e8c-4462-805e-1e48e4f21350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1751a370-99ff-4b42-8a25-aa5a10cfdb0d tempest-CinderUnicodeTest-2014760125 None] Created volume successfully. Jul 15 18:49:27 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572" returned: 0 in 0.424s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:27 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572 Jul 15 18:49:27 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:28 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c6320cc5-04bd-4078-a191-169a71eb7572" returned: 0 in 0.307s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-c6320cc5-04bd-4078-a191-169a71eb7572" released by "delete_volume" :: held 0.805s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created reservations ['61a98b27-116f-4979-b4f7-6d1797dc6fe2', 'ecd818fd-0c15-44a1-b82f-adad972d8791', 'ea78106c-f58c-4170-8c1d-d762b91d4204', '381ffd0c-6e49-4c5c-8698-d76b5f480446'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:28 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:28 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Creating offline snapshot 8db75541-66a1-44e0-861c-6225fec902c3 of volume d3d6b9f2-9e57-4731-bb33-3be127eeaa41 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca53a42-c883-4885-84e1-78195a58a3fd]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:28 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.295s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:28 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Deleted volume successfully. Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d35a0134-6709-4707-9669-fe7926d9287c tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-c6320cc5-04bd-4078-a191-169a71eb7572-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:28 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 Jul 15 18:49:28 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:28 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-d7fc5126-587d-4b01-bab0-8406db4275b0-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" returned: 0 in 0.495s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-d7fc5126-587d-4b01-bab0-8406db4275b0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:28 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 1G Jul 15 18:49:28 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "cinder-quobyte-d7fc5126-587d-4b01-bab0-8406db4275b0" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-d7fc5126-587d-4b01-bab0-8406db4275b0" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb73b84-a0a8-4cfc-a818-cef8d9894664]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:29 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0 Jul 15 18:49:29 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (8ae17378-1ff3-4028-8618-92352bb622ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cff19d-0648-45b7-a859-c0ff95345f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cff19d-0648-45b7-a859-c0ff95345f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-821991473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5981c5f1-49dd-4bf8-8256-c2f09ae2c47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:29Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d4f157-4b01-4565-874f-b76dafbf03c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d4f157-4b01-4565-874f-b76dafbf03c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6a8d30-c9aa-430d-bcb6-fcf8826452c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6a8d30-c9aa-430d-bcb6-fcf8826452c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5981c5f1-49dd-4bf8-8256-c2f09ae2c47f', 'volume_name': 'volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69159371-10ab-49ee-976d-612a78dee4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69159371-10ab-49ee-976d-612a78dee4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258bac87-8a82-4a42-9cc6-db50d1cb9aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:29 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Volume 5981c5f1-49dd-4bf8-8256-c2f09ae2c47f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f', 'volume_size': 1} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:29 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 1G" returned: 0 in 0.507s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:29 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 Jul 15 18:49:29 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:29 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0" returned: 0 in 0.402s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:29 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0 Jul 15 18:49:29 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:29 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d7fc5126-587d-4b01-bab0-8406db4275b0" returned: 0 in 0.250s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:29 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3" returned: 0 in 0.293s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:29 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 is being set with open permissions: ugo+rw Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-quobyte-d7fc5126-587d-4b01-bab0-8406db4275b0" released by "delete_volume" :: held 0.703s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:29 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 Jul 15 18:49:29 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Created reservations ['69816752-0c94-48ac-9ba2-e8fefc5b912e', '5ffdaafd-dcec-44bd-9e3c-7344cfa6b77a', 'e217c124-4b1a-4e9f-b073-0c7683b5c7ae', '779e9d54-4d2c-40a8-86a2-ad943fccb39f'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:29 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:29 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:29 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3" returned: 0 in 0.263s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:30 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.info Jul 15 18:49:30 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:30 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.312s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:30 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Deleted volume successfully. Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ba36bc95-26c7-44e0-8620-871ea1bcf145 tempest-CreateVolumesFromSourceVolumeTest-1041657752 None] Lock "cinder-d7fc5126-587d-4b01-bab0-8406db4275b0-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:30 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.info" returned: 0 in 0.300s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:30 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.info is being set with open permissions: ugo+rw Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:30 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.info Jul 15 18:49:30 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:30 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.info" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-821991473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5981c5f1-49dd-4bf8-8256-c2f09ae2c47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:29Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Creating volume 5981c5f1-49dd-4bf8-8256-c2f09ae2c47f {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:30 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:30 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f 1073741824 Jul 15 18:49:30 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:30 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-eead1cfd-8278-4ce8-b89b-11a19c1c78fb tempest-CinderUnicodeTest-2014760125 None] Create snapshot completed successfully Jul 15 18:49:31 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f 1073741824" returned: 0 in 0.586s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:31 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f Jul 15 18:49:31 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:31 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" returned: 0 in 0.277s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258bac87-8a82-4a42-9cc6-db50d1cb9aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9294226c-034f-414a-bb71-038879bfb32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "cinder-8db75541-66a1-44e0-861c-6225fec902c3-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:31 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Volume volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f (5981c5f1-49dd-4bf8-8256-c2f09ae2c47f): created successfully Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9294226c-034f-414a-bb71-038879bfb32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (8ae17378-1ff3-4028-8618-92352bb622ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-8db75541-66a1-44e0-861c-6225fec902c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "cinder-quobyte-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-quobyte-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "cinder-quobyte-8db75541-66a1-44e0-861c-6225fec902c3" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6a09ea26-17fc-4b92-b055-230981022526 tempest-ProjectMemberTests-183694055 None] Created volume successfully. Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-quobyte-8db75541-66a1-44e0-861c-6225fec902c3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Deleting offline snapshot 8db75541-66a1-44e0-861c-6225fec902c3 of volume d3d6b9f2-9e57-4731-bb33-3be127eeaa41 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] snapshot_file for this snap is: volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e50e2f6-cfa4-4b3b-9112-ae4dd4fc9505]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:31 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 Jul 15 18:49:31 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:32 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3" returned: 0 in 0.443s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a775e38c-43b8-4bc0-885a-67f6e7a4450e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:32 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 Jul 15 18:49:32 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:32 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" returned: 0 in 0.527s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:32 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 Jul 15 18:49:32 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Creating offline snapshot 78ef42b6-d581-4b6a-bb78-61a2e8a253b0 of volume 5981c5f1-49dd-4bf8-8256-c2f09ae2c47f {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[793c6b0d-8d75-4c8a-a5d7-d9b91de08f4c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:33 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f Jul 15 18:49:33 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:33 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3" returned: 0 in 0.525s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:33 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" returned: 0 in 0.460s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:33 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3 Jul 15 18:49:33 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:33 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 1G Jul 15 18:49:33 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:33 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41.8db75541-66a1-44e0-861c-6225fec902c3" returned: 0 in 0.286s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-quobyte-8db75541-66a1-44e0-861c-6225fec902c3" released by "_delete_snapshot" :: held 1.921s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-quobyte-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" released by "delete_snapshot" :: held 1.960s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Created reservations ['6038c3af-f02c-4846-a538-8fce441dc7be', '66a17fa4-624b-4f6f-be6e-1fd731eff6b9', '75a7c97b-ed1f-4bec-bca7-7bec4734df1c', '253f1cb2-3887-4d7d-be84-879da6c34102'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:33 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 1G" returned: 0 in 0.548s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:33 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Delete snapshot completed successfully. Jul 15 18:49:33 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b6eedc9d-216b-4cf0-a04b-bc4ba46119d9 tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-8db75541-66a1-44e0-861c-6225fec902c3-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:33 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 Jul 15 18:49:33 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:34 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0" returned: 0 in 0.304s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:34 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 is being set with open permissions: ugo+rw Jul 15 18:49:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:34 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 Jul 15 18:49:34 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:34 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0" returned: 0 in 0.266s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:34 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.info Jul 15 18:49:34 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:34 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.info" returned: 0 in 0.354s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:34 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.info is being set with open permissions: ugo+rw Jul 15 18:49:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:34 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.info Jul 15 18:49:34 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "cinder-d3d6b9f2-9e57-4731-bb33-3be127eeaa41-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-d3d6b9f2-9e57-4731-bb33-3be127eeaa41-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "cinder-quobyte-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-quobyte-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9086e9e-aaa3-498f-ac1c-9c0267e13fe1]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:35 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.info" returned: 0 in 0.308s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:35 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:35 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:35 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 Jul 15 18:49:35 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:35 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-0a646131-1926-4806-b716-1cd504148713 tempest-ProjectMemberTests-183694055 None] Create snapshot completed successfully Jul 15 18:49:35 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.344s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:49:35 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" returned: 0 in 0.459s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:35 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41 Jul 15 18:49:35 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:35 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" returned: 0 in 0.328s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-quobyte-d3d6b9f2-9e57-4731-bb33-3be127eeaa41" released by "delete_volume" :: held 0.872s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-78ef42b6-d581-4b6a-bb78-61a2e8a253b0-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Created reservations ['ffa17ea5-1766-4bf3-b95f-d01b3dab34e8', '7ba40893-2c55-42b7-ab2a-e6aa67151c7c', '327ebede-027a-48e0-beaa-456e57639da0', '854268cc-57cc-4203-a5c0-5e2cba19c0f8'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Lock "cinder-78ef42b6-d581-4b6a-bb78-61a2e8a253b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-78ef42b6-d581-4b6a-bb78-61a2e8a253b0" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-78ef42b6-d581-4b6a-bb78-61a2e8a253b0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Deleting offline snapshot 78ef42b6-d581-4b6a-bb78-61a2e8a253b0 of volume 5981c5f1-49dd-4bf8-8256-c2f09ae2c47f {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] snapshot_file for this snap is: volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[686c87a5-1d85-48c2-92e4-b1b34945b746]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:36 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:36 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:36 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 Jul 15 18:49:36 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:36 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.360s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:36 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Deleted volume successfully. Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b0b5f48b-db28-4ac8-b909-80155103fd1f tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-d3d6b9f2-9e57-4731-bb33-3be127eeaa41-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:36 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0" returned: 0 in 0.516s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ee116-528e-4db0-806e-8b5c495a975b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:36 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f Jul 15 18:49:36 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:37 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" returned: 0 in 0.441s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "cinder-3048f5e6-0627-4428-aeaa-f3eb4bd7d319-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:37 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 Jul 15 18:49:37 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-3048f5e6-0627-4428-aeaa-f3eb4bd7d319-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "cinder-quobyte-3048f5e6-0627-4428-aeaa-f3eb4bd7d319" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-quobyte-3048f5e6-0627-4428-aeaa-f3eb4bd7d319" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a67e9bc-f7a6-41ca-9b34-a4ace0981221]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:37 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319 Jul 15 18:49:37 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:37 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0" returned: 0 in 0.462s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:37 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0 Jul 15 18:49:37 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:37 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319" returned: 0 in 0.470s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:37 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319 Jul 15 18:49:37 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:38 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f.78ef42b6-d581-4b6a-bb78-61a2e8a253b0" returned: 0 in 0.336s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-78ef42b6-d581-4b6a-bb78-61a2e8a253b0" released by "_delete_snapshot" :: held 1.920s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" released by "delete_snapshot" :: held 1.956s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:38 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-3048f5e6-0627-4428-aeaa-f3eb4bd7d319" returned: 0 in 0.303s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-quobyte-3048f5e6-0627-4428-aeaa-f3eb4bd7d319" released by "delete_volume" :: held 0.831s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Created reservations ['292d1e94-0599-4742-b31d-e444e9a6a495', 'd1c0a512-bef7-4eb3-88fb-d094c85b81c6', '4f7a23ad-9946-47e6-99ec-bff649f6c4ff', '4e46c2cb-d715-4aab-8269-6b618bc92d6a'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Delete snapshot completed successfully. Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d49acc5c-71b8-43c7-8fc2-4571fe72fbcf tempest-ProjectMemberTests-183694055 None] Lock "cinder-78ef42b6-d581-4b6a-bb78-61a2e8a253b0-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Created reservations ['645ccd14-39ae-449d-9e89-d90419939869', '4b51831c-57e8-4c6d-b122-287d8fc3d2df', '10320797-2b70-4d51-8a0f-92a0f5a353d8', '38e8d3a2-8269-47f7-8fbc-4982b66a2369'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:38 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:38 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:38 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.266s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:38 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Deleted volume successfully. Jul 15 18:49:38 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-436fb46f-183e-4bc8-b5f5-d7621f6ceee7 tempest-CinderUnicodeTest-2014760125 None] Lock "cinder-3048f5e6-0627-4428-aeaa-f3eb4bd7d319-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Lock "cinder-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:39 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2736d7-bbde-4f02-9800-b026b85d5ced]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:39 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f Jul 15 18:49:39 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:39 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" returned: 0 in 0.444s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:40 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f Jul 15 18:49:40 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:40 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" returned: 0 in 0.347s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f" released by "delete_volume" :: held 0.870s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Created reservations ['ef6956aa-5860-4c73-af37-c0b68a37babc', '0e252da1-6793-413a-ba45-922d0e436d65', '94892eca-7a4e-4f11-913f-7fd20ca241dd', '37dc0b89-df28-4826-85a3-01b7b7402f40'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:40 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:40 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:40 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.321s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:40 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Deleted volume successfully. Jul 15 18:49:40 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5cc65192-85db-4b3c-be7a-330a7700ccab tempest-ProjectMemberTests-183694055 None] Lock "cinder-5981c5f1-49dd-4bf8-8256-c2f09ae2c47f-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (1487eb2d-52a1-4f43-9ab4-d0bc12a3da8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca87ae9-b2a3-4833-b9c2-00c6353df32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca87ae9-b2a3-4833-b9c2-00c6353df32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141616416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb743ad-9f19-48d7-9046-7eeef7f61929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:41Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2184ff71-9283-47ca-abc6-e785c27556ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2184ff71-9283-47ca-abc6-e785c27556ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8e18eb-36b8-4f48-a07e-2a728ec2bcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8e18eb-36b8-4f48-a07e-2a728ec2bcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceb743ad-9f19-48d7-9046-7eeef7f61929', 'volume_name': 'volume-ceb743ad-9f19-48d7-9046-7eeef7f61929', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce598cf-739d-4050-9480-d96f00557f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce598cf-739d-4050-9480-d96f00557f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea88ad68-b946-4225-b96d-5c03698eed01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:41 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Volume ceb743ad-9f19-48d7-9046-7eeef7f61929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceb743ad-9f19-48d7-9046-7eeef7f61929', 'volume_size': 1} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141616416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb743ad-9f19-48d7-9046-7eeef7f61929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:41Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Creating volume ceb743ad-9f19-48d7-9046-7eeef7f61929 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:41 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:41 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 1073741824 Jul 15 18:49:41 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:41 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 1073741824" returned: 0 in 0.612s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:42 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 Jul 15 18:49:42 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:42 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929" returned: 0 in 0.325s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea88ad68-b946-4225-b96d-5c03698eed01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb743ad-9f19-48d7-9046-7eeef7f61929', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50570867-5bf5-4571-8ee5-0b965d2b4628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:42 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Volume volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 (ceb743ad-9f19-48d7-9046-7eeef7f61929): created successfully Jul 15 18:49:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50570867-5bf5-4571-8ee5-0b965d2b4628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:42 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (1487eb2d-52a1-4f43-9ab4-d0bc12a3da8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:42 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1abfad3f-4b9a-4385-8cb2-9e6dd7172155 tempest-ProjectMemberTests-183694055 None] Created volume successfully. Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Flow 'volume_create_manager' (97190548-56d6-4212-aadb-5f8a2df1e85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663e888e-eab9-4779-8774-5142073e6bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=213,cinder:UPDATE=293,cinder:DELETE=30,cinder:INSERT=76 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663e888e-eab9-4779-8774-5142073e6bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061595498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5343a60f-6509-4e4a-8d6b-493b71d2067a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d432b72ff5fc4417aa9c41774488cf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:43Z,use_quota=True,user_id='87725c10c668437ba756d9956bd5d45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1333e26a-fae1-4a9e-9c21-d915d48fd843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1333e26a-fae1-4a9e-9c21-d915d48fd843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd42c4a-03b7-4d7b-aa90-cfd413ad512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd42c4a-03b7-4d7b-aa90-cfd413ad512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5343a60f-6509-4e4a-8d6b-493b71d2067a', 'volume_name': 'volume-5343a60f-6509-4e4a-8d6b-493b71d2067a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0115bb-736a-4b8d-8c8c-a119872cb541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0115bb-736a-4b8d-8c8c-a119872cb541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f37f06-6d7c-46d2-b5e1-0d64c316d6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:43 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Volume 5343a60f-6509-4e4a-8d6b-493b71d2067a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5343a60f-6509-4e4a-8d6b-493b71d2067a', 'volume_size': 1} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061595498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5343a60f-6509-4e4a-8d6b-493b71d2067a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d432b72ff5fc4417aa9c41774488cf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:43Z,use_quota=True,user_id='87725c10c668437ba756d9956bd5d45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Creating volume 5343a60f-6509-4e4a-8d6b-493b71d2067a {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:43 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:43 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a 1073741824 Jul 15 18:49:43 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:44 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a 1073741824" returned: 0 in 0.636s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:44 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a Jul 15 18:49:44 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:44 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a" returned: 0 in 0.257s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.743s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f37f06-6d7c-46d2-b5e1-0d64c316d6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5343a60f-6509-4e4a-8d6b-493b71d2067a', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fbeaf9-8081-4be8-8fe2-255285f42987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Creating offline snapshot 6cb08ed4-5593-4ee8-b0f8-0787d4608d0e of volume ceb743ad-9f19-48d7-9046-7eeef7f61929 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:49:44 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Volume volume-5343a60f-6509-4e4a-8d6b-493b71d2067a (5343a60f-6509-4e4a-8d6b-493b71d2067a): created successfully Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fbeaf9-8081-4be8-8fe2-255285f42987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Flow 'volume_create_manager' (97190548-56d6-4212-aadb-5f8a2df1e85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[93972130-7dc7-49df-b39f-27b7611f6709]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:44 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-457b7ac4-6e87-486f-a299-b0cd980d6519 tempest-ProjectReaderTests-790087695 None] Created volume successfully. Jul 15 18:49:44 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 Jul 15 18:49:44 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:44 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929" returned: 0 in 0.355s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:44 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e 1G Jul 15 18:49:44 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:45 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e 1G" returned: 0 in 0.400s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:45 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e Jul 15 18:49:45 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:45 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e" returned: 0 in 0.337s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:45 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e is being set with open permissions: ugo+rw Jul 15 18:49:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:45 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e Jul 15 18:49:45 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:45 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e" returned: 0 in 0.270s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:45 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.info Jul 15 18:49:45 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:46 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.info" returned: 0 in 0.270s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:46 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.info is being set with open permissions: ugo+rw Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:46 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.info Jul 15 18:49:46 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:46 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.info" returned: 0 in 0.253s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.787s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Creating offline snapshot 51f0545a-7b0e-4fd6-a996-96a6ff526381 of volume 5343a60f-6509-4e4a-8d6b-493b71d2067a {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:49:46 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a2d9e7d5-2619-4f52-8a21-dcbbd653f70a tempest-ProjectMemberTests-183694055 None] Create snapshot completed successfully Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bd5029-ea8c-47c3-abca-720cfe61d91a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:46 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a Jul 15 18:49:46 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-6cb08ed4-5593-4ee8-b0f8-0787d4608d0e-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Lock "cinder-6cb08ed4-5593-4ee8-b0f8-0787d4608d0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-ceb743ad-9f19-48d7-9046-7eeef7f61929" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-ceb743ad-9f19-48d7-9046-7eeef7f61929" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-6cb08ed4-5593-4ee8-b0f8-0787d4608d0e" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:46 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a" returned: 0 in 0.395s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-6cb08ed4-5593-4ee8-b0f8-0787d4608d0e" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Deleting offline snapshot 6cb08ed4-5593-4ee8-b0f8-0787d4608d0e of volume ceb743ad-9f19-48d7-9046-7eeef7f61929 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:46 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 1G Jul 15 18:49:46 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] snapshot_file for this snap is: volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5b576f-b421-4027-a547-2ccef73fd446]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:47 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e Jul 15 18:49:47 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:47 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e" returned: 0 in 0.407s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ceb743ad-9f19-48d7-9046-7eeef7f61929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:47 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 1G" returned: 0 in 0.498s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5343a60f-6509-4e4a-8d6b-493b71d2067a -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9720ef-ce29-455f-a956-9d3bb1c202ab]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:47 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5343a60f-6509-4e4a-8d6b-493b71d2067a -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 Jul 15 18:49:47 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:47 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 Jul 15 18:49:47 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:47 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5343a60f-6509-4e4a-8d6b-493b71d2067a -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381" returned: 0 in 0.322s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:47 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 is being set with open permissions: ugo+rw Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:47 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 Jul 15 18:49:47 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:47 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929" returned: 0 in 0.433s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:47 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e Jul 15 18:49:47 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:47 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381" returned: 0 in 0.279s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:47 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:48 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.info Jul 15 18:49:48 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:48 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e" returned: 0 in 0.388s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:48 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e Jul 15 18:49:48 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:48 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.info" returned: 0 in 0.293s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:48 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.info is being set with open permissions: ugo+rw Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:48 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.info Jul 15 18:49:48 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:48 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929.6cb08ed4-5593-4ee8-b0f8-0787d4608d0e" returned: 0 in 0.263s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-6cb08ed4-5593-4ee8-b0f8-0787d4608d0e" released by "_delete_snapshot" :: held 1.603s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-ceb743ad-9f19-48d7-9046-7eeef7f61929" released by "delete_snapshot" :: held 1.653s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:48 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.info" returned: 0 in 0.265s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Created reservations ['7be51658-3292-4741-9d78-3e84ce00c527', 'feff22a1-f2f1-41a0-999c-1214b73a71d4', 'a0e19edb-5a45-45fd-a68d-d284c6e4f448', '5edf15b3-7732-4518-bb94-b6b03e8bb0d4'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-79ae46be-3242-432e-b4b5-4cf2b5a3ea64 tempest-ProjectReaderTests-790087695 None] Create snapshot completed successfully Jul 15 18:49:48 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Delete snapshot completed successfully. Jul 15 18:49:48 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-3a2176c1-256f-44f8-9c94-009d70e286dd tempest-ProjectMemberTests-183694055 None] Lock "cinder-6cb08ed4-5593-4ee8-b0f8-0787d4608d0e-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-51f0545a-7b0e-4fd6-a996-96a6ff526381-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Lock "cinder-51f0545a-7b0e-4fd6-a996-96a6ff526381-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-5343a60f-6509-4e4a-8d6b-493b71d2067a" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-5343a60f-6509-4e4a-8d6b-493b71d2067a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-51f0545a-7b0e-4fd6-a996-96a6ff526381" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-51f0545a-7b0e-4fd6-a996-96a6ff526381" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Deleting offline snapshot 51f0545a-7b0e-4fd6-a996-96a6ff526381 of volume 5343a60f-6509-4e4a-8d6b-493b71d2067a {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] snapshot_file for this snap is: volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05973ea-d469-42a6-8546-c2c397bcedb8]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-ceb743ad-9f19-48d7-9046-7eeef7f61929-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Lock "cinder-ceb743ad-9f19-48d7-9046-7eeef7f61929-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-ceb743ad-9f19-48d7-9046-7eeef7f61929" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-ceb743ad-9f19-48d7-9046-7eeef7f61929" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:49 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 Jul 15 18:49:49 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8198142-c96e-4b26-b264-e231155b27e6]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:49 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 Jul 15 18:49:49 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Flow 'volume_create_manager' (73349c9a-16f2-46c8-b085-fa73406bfdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564b0dff-8240-4d9b-8665-3801b00a937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564b0dff-8240-4d9b-8665-3801b00a937a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-588335197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8701dd4a-24bf-4e1d-84ba-ded6746f5bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741613645f334c0ab26df14d872ae205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:49Z,use_quota=True,user_id='18a0090a307b4e328fc8f5aeddf78e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6294d3d9-f5c6-4859-ac78-be9bf848b5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6294d3d9-f5c6-4859-ac78-be9bf848b5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79d24dd-15e2-426d-8d84-93cce2b8fdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79d24dd-15e2-426d-8d84-93cce2b8fdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8701dd4a-24bf-4e1d-84ba-ded6746f5bff', 'volume_name': 'volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:49 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadfb819-c3b6-41b5-beb5-0aab340a4367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadfb819-c3b6-41b5-beb5-0aab340a4367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73478c4a-f5b8-471b-9a1a-9e4805e3af10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:49 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Volume 8701dd4a-24bf-4e1d-84ba-ded6746f5bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff', 'volume_size': 1} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-588335197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8701dd4a-24bf-4e1d-84ba-ded6746f5bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741613645f334c0ab26df14d872ae205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:49Z,use_quota=True,user_id='18a0090a307b4e328fc8f5aeddf78e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Creating volume 8701dd4a-24bf-4e1d-84ba-ded6746f5bff {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:49 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381" returned: 0 in 0.456s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5343a60f-6509-4e4a-8d6b-493b71d2067a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:49 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff 1073741824 Jul 15 18:49:49 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b2758a-c5a9-4a7d-a1e8-9d601d84805c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:49 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929" returned: 0 in 0.377s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:49 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929 Jul 15 18:49:49 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:49 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a Jul 15 18:49:49 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:49 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-ceb743ad-9f19-48d7-9046-7eeef7f61929" returned: 0 in 0.279s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-ceb743ad-9f19-48d7-9046-7eeef7f61929" released by "delete_volume" :: held 0.751s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:50 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a" returned: 0 in 0.402s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:50 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff 1073741824" returned: 0 in 0.477s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:50 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 Jul 15 18:49:50 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Created reservations ['15f5106d-dd4f-4c11-abd6-d53d9616358d', '585bcf71-39af-4700-9653-c7ebd5cd498c', 'a107300f-eb5f-4de1-bb29-7d945d2fc703', 'd7288510-5131-41bf-b186-f82f15f2fc74'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:50 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff Jul 15 18:49:50 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:50 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:50 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:50 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73478c4a-f5b8-471b-9a1a-9e4805e3af10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc6ba9d-9e4d-4f4f-b45c-73658ffa29d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:50 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:50 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Volume volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff (8701dd4a-24bf-4e1d-84ba-ded6746f5bff): created successfully Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc6ba9d-9e4d-4f4f-b45c-73658ffa29d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Flow 'volume_create_manager' (73349c9a-16f2-46c8-b085-fa73406bfdc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381" returned: 0 in 0.391s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1eab5010-a3de-47f9-a439-2cc6fe8e4c1d tempest-ProjectReaderTests-53111329 None] Created volume successfully. Jul 15 18:49:50 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381 Jul 15 18:49:50 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:50 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.287s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Deleted volume successfully. Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-cab84607-6f4e-42e3-9d5c-1c199d000b1a tempest-ProjectMemberTests-183694055 None] Lock "cinder-ceb743ad-9f19-48d7-9046-7eeef7f61929-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:50 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a.51f0545a-7b0e-4fd6-a996-96a6ff526381" returned: 0 in 0.279s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-51f0545a-7b0e-4fd6-a996-96a6ff526381" released by "_delete_snapshot" :: held 1.651s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-5343a60f-6509-4e4a-8d6b-493b71d2067a" released by "delete_snapshot" :: held 1.680s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Created reservations ['0a670d97-91d7-4199-a353-ab9e7ccbfeba', 'ac4988b2-b187-4c67-830a-fe3994a27bec', 'bddab61c-3983-467a-82b0-5c589ebfe179', '95ffea87-99d0-43a6-be15-120f5142fe35'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Delete snapshot completed successfully. Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-368d97c0-c465-45fa-8e1e-814c46acb241 tempest-ProjectReaderTests-790087695 None] Lock "cinder-51f0545a-7b0e-4fd6-a996-96a6ff526381-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (50750ae5-3af9-4b2a-988a-a69c1c3d9be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0547ad2a-1f4a-45b0-9751-c2b6ab332561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0547ad2a-1f4a-45b0-9751-c2b6ab332561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103892591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60c9b15-27c8-4a16-89e8-eab7b27b5b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:51Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa098da7-9eec-4e90-96db-32d3f805e2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa098da7-9eec-4e90-96db-32d3f805e2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29be0e2a-712b-4ab4-a259-41a5f0b6a3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29be0e2a-712b-4ab4-a259-41a5f0b6a3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60c9b15-27c8-4a16-89e8-eab7b27b5b86', 'volume_name': 'volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77564ede-0adb-4055-9c6b-d91debcac8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77564ede-0adb-4055-9c6b-d91debcac8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103714b5-71ae-4591-80ff-fd3ff5f7e581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:50 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Volume c60c9b15-27c8-4a16-89e8-eab7b27b5b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86', 'volume_size': 1} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103892591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60c9b15-27c8-4a16-89e8-eab7b27b5b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:51Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Creating volume c60c9b15-27c8-4a16-89e8-eab7b27b5b86 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:50 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:51 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 1073741824 Jul 15 18:49:51 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-5343a60f-6509-4e4a-8d6b-493b71d2067a-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Lock "cinder-5343a60f-6509-4e4a-8d6b-493b71d2067a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-5343a60f-6509-4e4a-8d6b-493b71d2067a" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-5343a60f-6509-4e4a-8d6b-493b71d2067a" acquired by "delete_volume" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca66e7ea-590f-48ac-a5d0-d466b2ba95c1]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:51 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 1073741824" returned: 0 in 0.426s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:51 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a Jul 15 18:49:51 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:51 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 Jul 15 18:49:51 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:51 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a" returned: 0 in 0.380s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:51 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Acquiring lock "cinder-8701dd4a-24bf-4e1d-84ba-ded6746f5bff-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" returned: 0 in 0.271s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:51 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:51 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Lock "cinder-8701dd4a-24bf-4e1d-84ba-ded6746f5bff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103714b5-71ae-4591-80ff-fd3ff5f7e581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c6c4fd-2783-4102-9687-d815c63893be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:51 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Volume volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 (c60c9b15-27c8-4a16-89e8-eab7b27b5b86): created successfully Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c6c4fd-2783-4102-9687-d815c63893be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (50750ae5-3af9-4b2a-988a-a69c1c3d9be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Acquiring lock "cinder-quobyte-8701dd4a-24bf-4e1d-84ba-ded6746f5bff" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:51 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ded59723-c8a4-41f5-b9a3-aad1c3dbd150 tempest-ProjectMemberTests-183694055 None] Created volume successfully. Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Lock "cinder-quobyte-8701dd4a-24bf-4e1d-84ba-ded6746f5bff" acquired by "delete_volume" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e2de03-9d86-4636-b335-857e2fc7956a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:51 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-5343a60f-6509-4e4a-8d6b-493b71d2067a" returned: 0 in 0.280s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:51 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-5343a60f-6509-4e4a-8d6b-493b71d2067a" released by "delete_volume" :: held 0.720s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:51 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff Jul 15 18:49:51 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Created reservations ['b495c8b3-7a80-491e-8a65-2ab35770a95f', 'f8e50e7b-0ba6-42e0-858b-83408c8438e4', '320f134b-58c2-48fc-9749-403ba7e4dc68', 'a6506c30-b5ec-4ce6-8744-b5ee38c87540'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Creating offline snapshot afd257a7-9722-4f26-a76d-2492c11cbde6 of volume c60c9b15-27c8-4a16-89e8-eab7b27b5b86 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:49:52 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:52 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1745d2c-7c6f-4d09-8677-493ecaf200bc]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:52 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff" returned: 0 in 0.383s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:52 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 Jul 15 18:49:52 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff Jul 15 18:49:52 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:52 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:52 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.285s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:52 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Deleted volume successfully. Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-7360f8f4-f086-4aa6-ad01-2c0afe1bb176 tempest-ProjectReaderTests-790087695 None] Lock "cinder-5343a60f-6509-4e4a-8d6b-493b71d2067a-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:52 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-8701dd4a-24bf-4e1d-84ba-ded6746f5bff" returned: 0 in 0.280s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Lock "cinder-quobyte-8701dd4a-24bf-4e1d-84ba-ded6746f5bff" released by "delete_volume" :: held 0.715s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:52 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" returned: 0 in 0.412s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:52 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 1G Jul 15 18:49:52 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Created reservations ['48e2dbfc-6692-42ac-9a5c-1856bd2a3467', '45e4c1e3-a20c-406b-aed6-8a96a69da3a6', '72deba92-ff4e-4ac8-b06f-1931eaa087cb', 'af7468d9-9f48-435b-93f9-c4585562822a'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:52 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:52 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Flow 'volume_create_manager' (96388f9f-5005-4410-adcc-710cfc5dcf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e903492-15a5-4be9-a1c9-963ff86d92c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e903492-15a5-4be9-a1c9-963ff86d92c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-315004077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f358edb-2938-49e7-96fb-c4f31b7dcb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d432b72ff5fc4417aa9c41774488cf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:53Z,use_quota=True,user_id='87725c10c668437ba756d9956bd5d45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624b7488-0c13-42bd-82dc-c1663f6d8a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624b7488-0c13-42bd-82dc-c1663f6d8a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61a032a-3b9f-487c-96b9-b698862c7a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:52 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61a032a-3b9f-487c-96b9-b698862c7a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f358edb-2938-49e7-96fb-c4f31b7dcb29', 'volume_name': 'volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05eba3f2-8bb2-4575-90c4-90c32fe47385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05eba3f2-8bb2-4575-90c4-90c32fe47385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d8689f-4043-4486-aeb4-aa873c088086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:53 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Volume 6f358edb-2938-49e7-96fb-c4f31b7dcb29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29', 'volume_size': 1} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:53 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.302s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:53 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Deleted volume successfully. Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-821a99e1-aced-44a4-9c53-1d91d4ddebac tempest-ProjectReaderTests-53111329 None] Lock "cinder-8701dd4a-24bf-4e1d-84ba-ded6746f5bff-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:53 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 1G" returned: 0 in 0.647s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:53 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 Jul 15 18:49:53 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Flow 'volume_create_manager' (c81e9253-9425-4fb8-81ce-85fe749b499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f30f9e-795d-43ce-b50a-1f313a64e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f30f9e-795d-43ce-b50a-1f313a64e247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305724440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37973229-eb5b-49eb-87b6-aee1a3f6920e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741613645f334c0ab26df14d872ae205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:53Z,use_quota=True,user_id='18a0090a307b4e328fc8f5aeddf78e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac71f2af-e9c4-4924-ba47-3d71b11b0ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:53 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac71f2af-e9c4-4924-ba47-3d71b11b0ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cd36c2-3c38-4f50-b0dc-f7c6db24783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cd36c2-3c38-4f50-b0dc-f7c6db24783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37973229-eb5b-49eb-87b6-aee1a3f6920e', 'volume_name': 'volume-37973229-eb5b-49eb-87b6-aee1a3f6920e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e944d778-3761-45a5-82cc-cdeeda7db646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e944d778-3761-45a5-82cc-cdeeda7db646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ef23ba-1a7a-474d-84ff-5550f94a096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:53 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Volume 37973229-eb5b-49eb-87b6-aee1a3f6920e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37973229-eb5b-49eb-87b6-aee1a3f6920e', 'volume_size': 1} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6" returned: 0 in 0.326s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:53 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 is being set with open permissions: ugo+rw Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:53 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 Jul 15 18:49:53 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:53 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6" returned: 0 in 0.232s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:53 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.info Jul 15 18:49:53 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:54 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.info" returned: 0 in 0.240s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:54 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.info is being set with open permissions: ugo+rw Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:54 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.info Jul 15 18:49:54 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:54 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.info" returned: 0 in 0.246s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.294s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-315004077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f358edb-2938-49e7-96fb-c4f31b7dcb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d432b72ff5fc4417aa9c41774488cf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:53Z,use_quota=True,user_id='87725c10c668437ba756d9956bd5d45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Creating volume 6f358edb-2938-49e7-96fb-c4f31b7dcb29 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:54 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:54 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 1073741824 Jul 15 18:49:54 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-49ad9f8c-36ea-479a-ba46-b7443c72e617 tempest-ProjectMemberTests-183694055 None] Create snapshot completed successfully Jul 15 18:49:54 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 1073741824" returned: 0 in 0.398s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:54 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 Jul 15 18:49:54 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:55 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29" returned: 0 in 0.263s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305724440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37973229-eb5b-49eb-87b6-aee1a3f6920e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741613645f334c0ab26df14d872ae205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:53Z,use_quota=True,user_id='18a0090a307b4e328fc8f5aeddf78e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Creating volume 37973229-eb5b-49eb-87b6-aee1a3f6920e {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:55 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d8689f-4043-4486-aeb4-aa873c088086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:55 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e 1073741824 Jul 15 18:49:55 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dbcf1e-5905-4530-a642-12c818d35c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:55 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Volume volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 (6f358edb-2938-49e7-96fb-c4f31b7dcb29): created successfully Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dbcf1e-5905-4530-a642-12c818d35c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Flow 'volume_create_manager' (96388f9f-5005-4410-adcc-710cfc5dcf69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:55 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e276ef48-ddc8-46a1-bafc-bb742e62f879 tempest-ProjectReaderTests-790087695 None] Created volume successfully. Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-afd257a7-9722-4f26-a76d-2492c11cbde6-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Lock "cinder-afd257a7-9722-4f26-a76d-2492c11cbde6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-afd257a7-9722-4f26-a76d-2492c11cbde6" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-afd257a7-9722-4f26-a76d-2492c11cbde6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Deleting offline snapshot afd257a7-9722-4f26-a76d-2492c11cbde6 of volume c60c9b15-27c8-4a16-89e8-eab7b27b5b86 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] snapshot_file for this snap is: volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[355d8f79-0645-4be9-83ef-4033ffc2718a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:55 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 Jul 15 18:49:55 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:55 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e 1073741824" returned: 0 in 0.478s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:55 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e Jul 15 18:49:55 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:55 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6" returned: 0 in 0.355s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[729e2207-6644-4a72-96ea-e628f0f54242]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:55 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e" returned: 0 in 0.249s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ef23ba-1a7a-474d-84ff-5550f94a096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37973229-eb5b-49eb-87b6-aee1a3f6920e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0c4c49-2e00-4575-94be-e042a76752f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:55 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 Jul 15 18:49:55 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:55 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Volume volume-37973229-eb5b-49eb-87b6-aee1a3f6920e (37973229-eb5b-49eb-87b6-aee1a3f6920e): created successfully Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0c4c49-2e00-4575-94be-e042a76752f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:55 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Flow 'volume_create_manager' (c81e9253-9425-4fb8-81ce-85fe749b499f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:55 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a88d43b0-a551-4083-ace2-f769814b5246 tempest-ProjectReaderTests-53111329 None] Created volume successfully. Jul 15 18:49:56 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" returned: 0 in 0.349s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:56 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 Jul 15 18:49:56 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Creating offline snapshot 0e5ebae9-338e-47df-917b-8bdbf4277911 of volume 6f358edb-2938-49e7-96fb-c4f31b7dcb29 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bd2cd4-85cc-4ff2-861b-dc915f9a64ee]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:56 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 Jul 15 18:49:56 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:56 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6" returned: 0 in 0.358s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:56 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6 Jul 15 18:49:56 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:56 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29" returned: 0 in 0.411s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:56 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 1G Jul 15 18:49:56 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:56 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Acquiring lock "cinder-37973229-eb5b-49eb-87b6-aee1a3f6920e-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86.afd257a7-9722-4f26-a76d-2492c11cbde6" returned: 0 in 0.268s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-afd257a7-9722-4f26-a76d-2492c11cbde6" released by "_delete_snapshot" :: held 1.427s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Lock "cinder-37973229-eb5b-49eb-87b6-aee1a3f6920e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" released by "delete_snapshot" :: held 1.459s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=224,cinder:UPDATE=301,cinder:DELETE=22,cinder:INSERT=85 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Acquiring lock "cinder-quobyte-37973229-eb5b-49eb-87b6-aee1a3f6920e" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Lock "cinder-quobyte-37973229-eb5b-49eb-87b6-aee1a3f6920e" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb8db4e-5605-4e04-81e4-1ad4e01c19af]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Created reservations ['9b3521f7-b382-4835-a0a2-0f6cb57e0f7b', 'f809ae5f-a7ef-47c3-929d-206f020f25d5', '443c7b90-8199-44db-a5e5-3cc4e18525e9', 'd7ecdda6-6959-4e9f-b29c-89dd6fd1deeb'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:56 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Delete snapshot completed successfully. Jul 15 18:49:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-99a9ad5a-af4e-4150-ba5b-7f2f3ab68ecf tempest-ProjectMemberTests-183694055 None] Lock "cinder-afd257a7-9722-4f26-a76d-2492c11cbde6-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:56 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e Jul 15 18:49:56 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:57 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 1G" returned: 0 in 0.434s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:57 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 Jul 15 18:49:57 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:57 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e" returned: 0 in 0.398s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:57 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e Jul 15 18:49:57 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:57 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911" returned: 0 in 0.305s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:57 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 is being set with open permissions: ugo+rw Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:57 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 Jul 15 18:49:57 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-c60c9b15-27c8-4a16-89e8-eab7b27b5b86-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Lock "cinder-c60c9b15-27c8-4a16-89e8-eab7b27b5b86-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:57 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-37973229-eb5b-49eb-87b6-aee1a3f6920e" returned: 0 in 0.313s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Lock "cinder-quobyte-37973229-eb5b-49eb-87b6-aee1a3f6920e" released by "delete_volume" :: held 0.753s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc16d0d1-5df7-4ef1-a9fb-7da44c302248]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Created reservations ['1812e111-5ac0-4115-91b6-b25d70c5a654', '38b940e7-27db-4542-9a5b-51f40a72b5ee', '9b9cac58-cb78-4203-b21d-b23558bccdf9', '5684b5cb-4d3d-4e5f-afd1-32cc1602b861'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:57 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911" returned: 0 in 0.262s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:57 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 Jul 15 18:49:57 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:57 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.info Jul 15 18:49:57 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:57 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:57 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:58 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:58 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.info" returned: 0 in 0.348s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" returned: 0 in 0.462s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:58 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.info is being set with open permissions: ugo+rw Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:58 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.338s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:58 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.info Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:58 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:58 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86 Jul 15 18:49:58 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:58 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Deleted volume successfully. Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2a1bf2ae-10ba-44e0-b79c-4c97e29e457c tempest-ProjectReaderTests-53111329 None] Lock "cinder-37973229-eb5b-49eb-87b6-aee1a3f6920e-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:58 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.info" returned: 0 in 0.270s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:58 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" returned: 0 in 0.300s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-c60c9b15-27c8-4a16-89e8-eab7b27b5b86" released by "delete_volume" :: held 0.837s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:58 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6f579e80-73b8-4670-9e4f-0a023bc6319d tempest-ProjectReaderTests-790087695 None] Create snapshot completed successfully Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Created reservations ['8e4fddc7-7206-495b-b636-fbd320be84ae', '804d87fd-8801-464a-80ca-0c216aae551a', '7ed9f1ff-23d0-4a1d-8e14-e4e5a24b9c01', 'f9c1c468-2921-4d09-8eb3-a10f74d2bc55'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Flow 'volume_create_manager' (77b3c9cf-261b-490d-a7e3-cbbb52dd88c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c24db69-6f43-4fc4-84cb-d3b39a4c143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c24db69-6f43-4fc4-84cb-d3b39a4c143a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361459023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e05c70a-1c32-4e16-a021-ca529000f4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741613645f334c0ab26df14d872ae205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:58Z,use_quota=True,user_id='18a0090a307b4e328fc8f5aeddf78e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990ac08f-a6fc-415c-8f06-61baeb6ee7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990ac08f-a6fc-415c-8f06-61baeb6ee7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91fb0ef-e521-422c-a8a6-ec660253c8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91fb0ef-e521-422c-a8a6-ec660253c8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e05c70a-1c32-4e16-a021-ca529000f4bc', 'volume_name': 'volume-9e05c70a-1c32-4e16-a021-ca529000f4bc', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a2cbec-4467-4aac-9f14-b939c5a6fdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a2cbec-4467-4aac-9f14-b939c5a6fdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82129e48-d224-44c6-8666-499788c902c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:58 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Volume 9e05c70a-1c32-4e16-a021-ca529000f4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e05c70a-1c32-4e16-a021-ca529000f4bc', 'volume_size': 1} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361459023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e05c70a-1c32-4e16-a021-ca529000f4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741613645f334c0ab26df14d872ae205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:58Z,use_quota=True,user_id='18a0090a307b4e328fc8f5aeddf78e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Creating volume 9e05c70a-1c32-4e16-a021-ca529000f4bc {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:58 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:58 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc 1073741824 Jul 15 18:49:58 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:58 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:49:58 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:58 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.267s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:58 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Deleted volume successfully. Jul 15 18:49:58 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-65e4e415-3db3-4dae-86f4-9ecac5a06938 tempest-ProjectMemberTests-183694055 None] Lock "cinder-c60c9b15-27c8-4a16-89e8-eab7b27b5b86-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:59 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc 1073741824" returned: 0 in 0.501s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:59 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc Jul 15 18:49:59 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (e90051dc-926a-40f7-ae77-a54fed1db318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a27724a-a456-41c2-b2d7-91ac5696a88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a27724a-a456-41c2-b2d7-91ac5696a88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41932881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecf7c7e-0bb8-43b9-b565-7a093531ac71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:59Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3767793-6c6a-49ad-999e-adf840498b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3767793-6c6a-49ad-999e-adf840498b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8914b8c-c1a5-4a92-b842-3d3c9d7e1f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8914b8c-c1a5-4a92-b842-3d3c9d7e1f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ecf7c7e-0bb8-43b9-b565-7a093531ac71', 'volume_name': 'volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb35d30-a47e-4d70-aba2-b26d117bba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb35d30-a47e-4d70-aba2-b26d117bba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc4d5b6-8401-40dd-bd83-57ffea5ac529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Volume 7ecf7c7e-0bb8-43b9-b565-7a093531ac71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71', 'volume_size': 1} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:59 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc" returned: 0 in 0.237s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.148s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41932881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecf7c7e-0bb8-43b9-b565-7a093531ac71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:59Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Creating volume 7ecf7c7e-0bb8-43b9-b565-7a093531ac71 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:59 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82129e48-d224-44c6-8666-499788c902c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e05c70a-1c32-4e16-a021-ca529000f4bc', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:59 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 1073741824 Jul 15 18:49:59 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be50e676-b932-44d0-99a6-1ad828373384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-0e5ebae9-338e-47df-917b-8bdbf4277911-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:59 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Volume volume-9e05c70a-1c32-4e16-a021-ca529000f4bc (9e05c70a-1c32-4e16-a021-ca529000f4bc): created successfully Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be50e676-b932-44d0-99a6-1ad828373384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Flow 'volume_create_manager' (77b3c9cf-261b-490d-a7e3-cbbb52dd88c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Lock "cinder-0e5ebae9-338e-47df-917b-8bdbf4277911-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-6f358edb-2938-49e7-96fb-c4f31b7dcb29" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:59 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3d7c6c54-f31f-4eb0-a77f-cd12c139d246 tempest-ProjectReaderTests-53111329 None] Created volume successfully. Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-6f358edb-2938-49e7-96fb-c4f31b7dcb29" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-0e5ebae9-338e-47df-917b-8bdbf4277911" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-0e5ebae9-338e-47df-917b-8bdbf4277911" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Deleting offline snapshot 0e5ebae9-338e-47df-917b-8bdbf4277911 of volume 6f358edb-2938-49e7-96fb-c4f31b7dcb29 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] snapshot_file for this snap is: volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f397fe6-9246-4073-83d4-cbe4d3213c11]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:59 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 Jul 15 18:49:59 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:59 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 1073741824" returned: 0 in 0.427s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:59 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 Jul 15 18:49:59 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:59 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911" returned: 0 in 0.372s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca5bdb9-18a9-41d1-864e-9163eba15767]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:00 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 Jul 15 18:50:00 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:00 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" returned: 0 in 0.253s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc4d5b6-8401-40dd-bd83-57ffea5ac529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1da31d-4e7f-4818-b806-ab2c59c95ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:00 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Volume volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 (7ecf7c7e-0bb8-43b9-b565-7a093531ac71): created successfully Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1da31d-4e7f-4818-b806-ab2c59c95ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (e90051dc-926a-40f7-ae77-a54fed1db318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:00 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b8f877eb-2dc5-4f1f-91be-d8680538f26c tempest-ProjectMemberTests-183694055 None] Created volume successfully. Jul 15 18:50:00 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29" returned: 0 in 0.348s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:00 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 Jul 15 18:50:00 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Acquiring lock "cinder-9e05c70a-1c32-4e16-a021-ca529000f4bc-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Lock "cinder-9e05c70a-1c32-4e16-a021-ca529000f4bc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:00 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911" returned: 0 in 0.356s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Acquiring lock "cinder-quobyte-9e05c70a-1c32-4e16-a021-ca529000f4bc" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:00 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911 Jul 15 18:50:00 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Lock "cinder-quobyte-9e05c70a-1c32-4e16-a021-ca529000f4bc" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e357edfa-8481-4f38-9b5f-df17c77bdd42]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:00 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc Jul 15 18:50:00 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:00 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29.0e5ebae9-338e-47df-917b-8bdbf4277911" returned: 0 in 0.261s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-0e5ebae9-338e-47df-917b-8bdbf4277911" released by "_delete_snapshot" :: held 1.422s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-6f358edb-2938-49e7-96fb-c4f31b7dcb29" released by "delete_snapshot" :: held 1.449s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:00 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Created reservations ['b81e1200-9cb5-4b1e-ad64-40455aec9573', '173d7211-83b6-4a4f-ae5f-30a4e303e648', '55494a34-13a9-4617-a6ef-f35fc998e4b5', '3b476b23-f677-41a9-865f-52dcc0c12575'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:01 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Delete snapshot completed successfully. Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-fbd6ba5a-d0f3-4486-b245-898d80e18c6d tempest-ProjectReaderTests-790087695 None] Lock "cinder-0e5ebae9-338e-47df-917b-8bdbf4277911-delete_snapshot" released by "delete_snapshot" :: held 1.593s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:01 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc" returned: 0 in 0.358s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:01 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc Jul 15 18:50:01 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:01 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9e05c70a-1c32-4e16-a021-ca529000f4bc" returned: 0 in 0.278s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Lock "cinder-quobyte-9e05c70a-1c32-4e16-a021-ca529000f4bc" released by "delete_volume" :: held 0.682s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Created reservations ['ad1b274c-837c-4691-8f51-7611ae509529', '655b2e2e-a052-47b8-aa26-238781abe6cb', '021017e5-5cf2-4193-8279-088eafcba00c', '45273f90-9b6a-4b32-8f24-4ab62dfceb97'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Creating offline snapshot eb339dd8-9715-4250-9068-5d4534223153 of volume 7ecf7c7e-0bb8-43b9-b565-7a093531ac71 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e26ebbc-623d-41eb-bc30-eaa0b1a9ce20]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:01 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:01 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-6f358edb-2938-49e7-96fb-c4f31b7dcb29-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:01 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Lock "cinder-6f358edb-2938-49e7-96fb-c4f31b7dcb29-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:01 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-6f358edb-2938-49e7-96fb-c4f31b7dcb29" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-6f358edb-2938-49e7-96fb-c4f31b7dcb29" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cb5881-7fc0-49a1-b550-1f2aa06b9f27]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:01 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 Jul 15 18:50:01 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:01 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.352s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:01 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Deleted volume successfully. Jul 15 18:50:01 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" returned: 0 in 0.457s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:01 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-2e55863c-8b97-4e1a-887f-8c656fbbee49 tempest-ProjectReaderTests-53111329 None] Lock "cinder-9e05c70a-1c32-4e16-a021-ca529000f4bc-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:01 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 1G Jul 15 18:50:01 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:02 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29" returned: 0 in 0.471s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:02 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29 Jul 15 18:50:02 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Flow 'volume_create_manager' (6f580bb3-c34e-4232-a19e-f063e42d6eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c495f908-dfde-4910-84bd-8015b94f618c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c495f908-dfde-4910-84bd-8015b94f618c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39079505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741613645f334c0ab26df14d872ae205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:02Z,use_quota=True,user_id='18a0090a307b4e328fc8f5aeddf78e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acc18b7-6b93-4a71-8e18-056229e606eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acc18b7-6b93-4a71-8e18-056229e606eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647fe78b-ab0f-4767-8a61-863a87c111e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647fe78b-ab0f-4767-8a61-863a87c111e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3', 'volume_name': 'volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6afdcc-ab7b-4d5a-8d14-f08384c4ef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6afdcc-ab7b-4d5a-8d14-f08384c4ef0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:02 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8783d316-0035-417f-a78c-8177f4baee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:02 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Volume 9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3', 'volume_size': 1} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 1G" returned: 0 in 0.459s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:02 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 Jul 15 18:50:02 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:02 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-6f358edb-2938-49e7-96fb-c4f31b7dcb29" returned: 0 in 0.269s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-6f358edb-2938-49e7-96fb-c4f31b7dcb29" released by "delete_volume" :: held 0.816s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Created reservations ['d7ec5061-15f5-486c-aba0-71ae2e8c4223', '47f94114-21ec-42d4-ad8a-68b3adc2229b', '1ce4fd97-8965-4564-937d-5d6814c329af', 'e952a5e2-565c-4183-934d-0a2c06cf69a4'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:02 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:02 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:02 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153" returned: 0 in 0.305s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:02 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 is being set with open permissions: ugo+rw Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:02 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 Jul 15 18:50:02 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:02 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.268s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:02 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Deleted volume successfully. Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-36f8e39b-a084-4a59-955b-a900087456c7 tempest-ProjectReaderTests-790087695 None] Lock "cinder-6f358edb-2938-49e7-96fb-c4f31b7dcb29-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:02 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153" returned: 0 in 0.256s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:02 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:02 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.info Jul 15 18:50:02 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:03 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Flow 'volume_create_manager' (a99c85ae-fa81-4ec2-8bc2-431a8b83ed33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14895ae2-5d48-4ed4-a779-ca5be4ef480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.info" returned: 0 in 0.308s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:03 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.info is being set with open permissions: ugo+rw Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14895ae2-5d48-4ed4-a779-ca5be4ef480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-600806562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da489fea-f50d-4d35-8d31-a36a46236d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d432b72ff5fc4417aa9c41774488cf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:03Z,use_quota=True,user_id='87725c10c668437ba756d9956bd5d45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:03 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.info Jul 15 18:50:03 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573df4ac-f3ce-4e2f-8cc1-1a95057adab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573df4ac-f3ce-4e2f-8cc1-1a95057adab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb46698-6495-45bf-ac83-54d71187c8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb46698-6495-45bf-ac83-54d71187c8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da489fea-f50d-4d35-8d31-a36a46236d62', 'volume_name': 'volume-da489fea-f50d-4d35-8d31-a36a46236d62', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5344c9-7ce1-4fcb-b0f4-203f6bde4112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5344c9-7ce1-4fcb-b0f4-203f6bde4112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b8f99f-a55f-4ff8-9567-92c2052d20f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:03 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Volume da489fea-f50d-4d35-8d31-a36a46236d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da489fea-f50d-4d35-8d31-a36a46236d62', 'volume_size': 1} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:03 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.info" returned: 0 in 0.236s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.150s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39079505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741613645f334c0ab26df14d872ae205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:02Z,use_quota=True,user_id='18a0090a307b4e328fc8f5aeddf78e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Creating volume 9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:03 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:03 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 1073741824 Jul 15 18:50:03 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:03 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-18074c2b-89de-407f-a373-ff8a263f8e4a tempest-ProjectMemberTests-183694055 None] Create snapshot completed successfully Jul 15 18:50:03 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 1073741824" returned: 0 in 0.425s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:04 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 Jul 15 18:50:04 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:04 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3" returned: 0 in 0.234s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-600806562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da489fea-f50d-4d35-8d31-a36a46236d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d432b72ff5fc4417aa9c41774488cf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:03Z,use_quota=True,user_id='87725c10c668437ba756d9956bd5d45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Creating volume da489fea-f50d-4d35-8d31-a36a46236d62 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:04 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8783d316-0035-417f-a78c-8177f4baee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:04 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 1073741824 Jul 15 18:50:04 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6370fcc2-5c1e-4882-96e3-b92d47943567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:04 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Volume volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 (9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3): created successfully Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6370fcc2-5c1e-4882-96e3-b92d47943567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Flow 'volume_create_manager' (6f580bb3-c34e-4232-a19e-f063e42d6eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:04 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-582620d4-0a1c-451b-8152-f6ea23f6e416 tempest-ProjectReaderTests-53111329 None] Created volume successfully. Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-eb339dd8-9715-4250-9068-5d4534223153-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Lock "cinder-eb339dd8-9715-4250-9068-5d4534223153-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-eb339dd8-9715-4250-9068-5d4534223153" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-eb339dd8-9715-4250-9068-5d4534223153" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Deleting offline snapshot eb339dd8-9715-4250-9068-5d4534223153 of volume 7ecf7c7e-0bb8-43b9-b565-7a093531ac71 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] snapshot_file for this snap is: volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b355806a-a2ff-48a6-838f-04f9db21c3a9]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:04 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 1073741824" returned: 0 in 0.452s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:04 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 Jul 15 18:50:04 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:04 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 Jul 15 18:50:04 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:04 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62" returned: 0 in 0.263s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:04 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b8f99f-a55f-4ff8-9567-92c2052d20f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da489fea-f50d-4d35-8d31-a36a46236d62', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb5768e-a1d8-42f2-957e-9be7d02ac9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:05 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Volume volume-da489fea-f50d-4d35-8d31-a36a46236d62 (da489fea-f50d-4d35-8d31-a36a46236d62): created successfully Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb5768e-a1d8-42f2-957e-9be7d02ac9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Flow 'volume_create_manager' (a99c85ae-fa81-4ec2-8bc2-431a8b83ed33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:05 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-2e2979bd-1dcb-4088-80dd-4a975059e601 tempest-ProjectReaderTests-790087695 None] Created volume successfully. Jul 15 18:50:05 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153" returned: 0 in 0.379s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed7c4cf-11f8-4393-9248-27c570757158]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:05 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 Jul 15 18:50:05 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:05 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Acquiring lock "cinder-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" returned: 0 in 0.405s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:05 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 Jul 15 18:50:05 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Lock "cinder-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Creating offline snapshot af7ff54b-bd10-4bfb-aa83-36b1be697339 of volume da489fea-f50d-4d35-8d31-a36a46236d62 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[436cb9c2-87a3-4f25-a14e-9ccda77327ea]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Acquiring lock "cinder-quobyte-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Lock "cinder-quobyte-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3356aa38-e83a-4c74-99e1-bbf50d8737f2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:05 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 Jul 15 18:50:05 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:05 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 Jul 15 18:50:05 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:05 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153" returned: 0 in 0.366s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:05 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153 Jul 15 18:50:05 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:05 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62" returned: 0 in 0.401s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:05 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:05 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 1G Jul 15 18:50:05 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:06 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3" returned: 0 in 0.388s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:06 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3 Jul 15 18:50:06 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:06 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71.eb339dd8-9715-4250-9068-5d4534223153" returned: 0 in 0.246s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-eb339dd8-9715-4250-9068-5d4534223153" released by "_delete_snapshot" :: held 1.489s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" released by "delete_snapshot" :: held 1.510s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Created reservations ['e677ba94-47af-422e-b8c7-18fafceddb5c', 'd983923c-f84d-4aea-b36f-55299f96f151', 'ed7579b9-2e08-4118-b8dd-be901b1c30c1', '676cca59-c1b7-4271-9696-b459c4a8e9fa'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Delete snapshot completed successfully. Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-b54b4fcb-cba2-4b30-8aca-fc52617e6487 tempest-ProjectMemberTests-183694055 None] Lock "cinder-eb339dd8-9715-4250-9068-5d4534223153-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:06 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3" returned: 0 in 0.293s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Lock "cinder-quobyte-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3" released by "delete_volume" :: held 0.730s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Created reservations ['98894cd1-cf7c-4ac7-8cea-0c8f9b94dcc1', '096819e0-fa13-4412-97fd-8893669b9f9e', '4e1cbe05-f5fe-4591-a5b7-3d1ae68120b2', 'b087290d-19fa-471a-90a2-fe2b7a8ad7e8'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:06 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 1G" returned: 0 in 0.460s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da489fea-f50d-4d35-8d31-a36a46236d62 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:06 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da489fea-f50d-4d35-8d31-a36a46236d62 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 Jul 15 18:50:06 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:06 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:06 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:06 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.253s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:06 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Deleted volume successfully. Jul 15 18:50:06 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da489fea-f50d-4d35-8d31-a36a46236d62 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339" returned: 0 in 0.318s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:06 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 is being set with open permissions: ugo+rw Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:06 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 Jul 15 18:50:06 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-d2321fe6-a8b2-4862-b4a2-36e1c6b90b52 tempest-ProjectReaderTests-53111329 None] Lock "cinder-9c1e5df4-f4b9-439a-b496-80b6d5b1b2c3-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-7ecf7c7e-0bb8-43b9-b565-7a093531ac71-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Lock "cinder-7ecf7c7e-0bb8-43b9-b565-7a093531ac71-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:06 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed445074-ad58-4d3c-8626-14bb06c95b3a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:07 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339" returned: 0 in 0.303s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:07 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.info Jul 15 18:50:07 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:07 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 Jul 15 18:50:07 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:07 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.info" returned: 0 in 0.260s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:07 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.info is being set with open permissions: ugo+rw Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:07 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.info Jul 15 18:50:07 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:07 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" returned: 0 in 0.407s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:07 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71 Jul 15 18:50:07 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:07 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.info" returned: 0 in 0.292s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:07 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c8456b98-0f17-4d40-a794-fb67f10eb0d5 tempest-ProjectReaderTests-790087695 None] Create snapshot completed successfully Jul 15 18:50:07 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" returned: 0 in 0.272s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-7ecf7c7e-0bb8-43b9-b565-7a093531ac71" released by "delete_volume" :: held 0.762s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Created reservations ['1cf1280b-8b53-4db1-a2c7-ad3891e601a0', 'fbdd4e84-13df-4368-8cd3-043b258220fb', '9b3ea403-5dea-4604-92bb-31bb2c6f8e15', '1b3772cf-fbee-49ed-9fcb-bd36dfb21f69'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:07 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:07 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:07 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:08 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.286s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:08 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Deleted volume successfully. Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-237d2482-828e-4fcf-a478-4353067ebeab tempest-ProjectMemberTests-183694055 None] Lock "cinder-7ecf7c7e-0bb8-43b9-b565-7a093531ac71-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (3ae0f36a-8fda-4186-9774-f16f00a1f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9039f1af-cf63-46f6-aca0-e29f223be585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9039f1af-cf63-46f6-aca0-e29f223be585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001749744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36cc943-1010-4e86-a0eb-79338b7ddbd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:08Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4021e79-4433-4229-b75d-82769affc11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4021e79-4433-4229-b75d-82769affc11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3b6e96-de4c-459f-b66c-48ad333e6cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3b6e96-de4c-459f-b66c-48ad333e6cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36cc943-1010-4e86-a0eb-79338b7ddbd9', 'volume_name': 'volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613d13d3-4402-4df2-b604-cf39c549df3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613d13d3-4402-4df2-b604-cf39c549df3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3988b473-c244-4c99-bb8b-b101354854d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:08 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Volume d36cc943-1010-4e86-a0eb-79338b7ddbd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9', 'volume_size': 1} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001749744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36cc943-1010-4e86-a0eb-79338b7ddbd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:08Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Creating volume d36cc943-1010-4e86-a0eb-79338b7ddbd9 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:08 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:08 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 1073741824 Jul 15 18:50:08 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-af7ff54b-bd10-4bfb-aa83-36b1be697339-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Lock "cinder-af7ff54b-bd10-4bfb-aa83-36b1be697339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-da489fea-f50d-4d35-8d31-a36a46236d62" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-da489fea-f50d-4d35-8d31-a36a46236d62" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-af7ff54b-bd10-4bfb-aa83-36b1be697339" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-af7ff54b-bd10-4bfb-aa83-36b1be697339" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Deleting offline snapshot af7ff54b-bd10-4bfb-aa83-36b1be697339 of volume da489fea-f50d-4d35-8d31-a36a46236d62 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] snapshot_file for this snap is: volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4738986e-cd36-411e-8f97-6af9da8d7dba]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:08 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:08 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 Jul 15 18:50:08 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:09 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 1073741824" returned: 0 in 0.446s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:09 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 Jul 15 18:50:09 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:09 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339" returned: 0 in 0.359s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da489fea-f50d-4d35-8d31-a36a46236d62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f3d246-30a8-4eb1-b4da-80cd9662202b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:09 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 Jul 15 18:50:09 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:09 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3988b473-c244-4c99-bb8b-b101354854d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f6bc7f-e0bd-4baa-961a-07c604fa3617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:09 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Volume volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 (d36cc943-1010-4e86-a0eb-79338b7ddbd9): created successfully Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f6bc7f-e0bd-4baa-961a-07c604fa3617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (3ae0f36a-8fda-4186-9774-f16f00a1f100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:09 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-04e055f1-b35b-4c8a-94db-0ffe6e43efc8 tempest-ProjectMemberTests-183694055 None] Created volume successfully. Jul 15 18:50:09 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62" returned: 0 in 0.392s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:09 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 Jul 15 18:50:09 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Creating offline snapshot ac72e4c6-7c7c-4f57-b763-fc83913fe336 of volume d36cc943-1010-4e86-a0eb-79338b7ddbd9 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fed19c-5426-45eb-89b3-1bff2246eadb]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:09 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 Jul 15 18:50:09 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:09 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339" returned: 0 in 0.357s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:09 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339 Jul 15 18:50:09 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:10 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9" returned: 0 in 0.380s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:10 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 1G Jul 15 18:50:10 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:10 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62.af7ff54b-bd10-4bfb-aa83-36b1be697339" returned: 0 in 0.234s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-af7ff54b-bd10-4bfb-aa83-36b1be697339" released by "_delete_snapshot" :: held 1.457s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-da489fea-f50d-4d35-8d31-a36a46236d62" released by "delete_snapshot" :: held 1.484s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Created reservations ['a313c3bb-2f99-4bd3-bf70-a380fd7a926b', 'e4d861f1-e87e-4a05-b43a-b11f8c64f767', 'b4543c5e-c32e-4ca8-a75f-ecc411297890', 'c2c68caa-03cb-4b48-b08c-a288416b0179'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:10 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Delete snapshot completed successfully. Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6f052874-a32f-4caf-8b21-69c9d3a3c19c tempest-ProjectReaderTests-790087695 None] Lock "cinder-af7ff54b-bd10-4bfb-aa83-36b1be697339-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:10 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:10 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 1G" returned: 0 in 0.401s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:10 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:10 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336" returned: 0 in 0.303s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:10 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 is being set with open permissions: ugo+rw Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:10 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 Jul 15 18:50:10 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-da489fea-f50d-4d35-8d31-a36a46236d62-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Lock "cinder-da489fea-f50d-4d35-8d31-a36a46236d62-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-da489fea-f50d-4d35-8d31-a36a46236d62" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-da489fea-f50d-4d35-8d31-a36a46236d62" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d49a786-fb7f-4750-a817-838c0e5a9634]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:11 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336" returned: 0 in 0.254s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:11 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 Jul 15 18:50:11 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:11 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.info Jul 15 18:50:11 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:11 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62" returned: 0 in 0.349s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:11 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.info" returned: 0 in 0.267s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:11 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.info is being set with open permissions: ugo+rw Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:11 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62 Jul 15 18:50:11 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:11 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.info Jul 15 18:50:11 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:11 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-da489fea-f50d-4d35-8d31-a36a46236d62" returned: 0 in 0.235s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:11 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.info" returned: 0 in 0.231s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-da489fea-f50d-4d35-8d31-a36a46236d62" released by "delete_volume" :: held 0.655s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:11 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-839c7b03-4a46-45a4-aa7f-4dd391659534 tempest-ProjectMemberTests-183694055 None] Create snapshot completed successfully Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Created reservations ['8296df5f-bcf3-4787-bb63-1c2702eca239', '3f2932e5-1a82-46d4-b2b4-bc475c2baa91', '677fb49a-e6cc-4fae-b7d5-4380d1a25c8f', '8a15c090-8e0d-431d-91a4-73e8fb994d9b'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:11 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:11 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-ac72e4c6-7c7c-4f57-b763-fc83913fe336-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Lock "cinder-ac72e4c6-7c7c-4f57-b763-fc83913fe336-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-d36cc943-1010-4e86-a0eb-79338b7ddbd9" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-d36cc943-1010-4e86-a0eb-79338b7ddbd9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-ac72e4c6-7c7c-4f57-b763-fc83913fe336" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-ac72e4c6-7c7c-4f57-b763-fc83913fe336" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Deleting offline snapshot ac72e4c6-7c7c-4f57-b763-fc83913fe336 of volume d36cc943-1010-4e86-a0eb-79338b7ddbd9 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] snapshot_file for this snap is: volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fa9c6c-7a37-447d-88fa-7275c4bb1dce]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:12 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.260s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:12 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Deleted volume successfully. Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-66b7b382-e237-49de-9940-0b1876171c99 tempest-ProjectReaderTests-790087695 None] Lock "cinder-da489fea-f50d-4d35-8d31-a36a46236d62-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:12 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 Jul 15 18:50:12 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:12 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336" returned: 0 in 0.397s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa489d09-6810-44d3-b1ab-d70a05606c61]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:12 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 Jul 15 18:50:12 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Flow 'volume_create_manager' (2ecdd8bf-d38c-4d51-80d4-a3cbee97e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9aedc5-81e5-480a-9a69-2974a95c6817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9aedc5-81e5-480a-9a69-2974a95c6817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1313221215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723514ee-0dca-4d76-884a-76c2e393bab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d432b72ff5fc4417aa9c41774488cf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:12Z,use_quota=True,user_id='87725c10c668437ba756d9956bd5d45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861f06a5-96cb-4e88-a5f7-c3f6d4cab26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861f06a5-96cb-4e88-a5f7-c3f6d4cab26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2779146-8d9d-40b7-8365-8eda443611e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2779146-8d9d-40b7-8365-8eda443611e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '723514ee-0dca-4d76-884a-76c2e393bab3', 'volume_name': 'volume-723514ee-0dca-4d76-884a-76c2e393bab3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9ec3d2-ef8f-48db-8230-60d4a37670b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9ec3d2-ef8f-48db-8230-60d4a37670b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2511d5f7-9e8f-4c5b-bbbb-48b5b568b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:12 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Volume 723514ee-0dca-4d76-884a-76c2e393bab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-723514ee-0dca-4d76-884a-76c2e393bab3', 'volume_size': 1} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1313221215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723514ee-0dca-4d76-884a-76c2e393bab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d432b72ff5fc4417aa9c41774488cf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:12Z,use_quota=True,user_id='87725c10c668437ba756d9956bd5d45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Creating volume 723514ee-0dca-4d76-884a-76c2e393bab3 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:12 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:12 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 1073741824 Jul 15 18:50:12 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:12 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9" returned: 0 in 0.373s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:12 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 Jul 15 18:50:12 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:13 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 1073741824" returned: 0 in 0.412s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:13 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 Jul 15 18:50:13 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:13 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336" returned: 0 in 0.356s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:13 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336 Jul 15 18:50:13 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:13 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3" returned: 0 in 0.249s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2511d5f7-9e8f-4c5b-bbbb-48b5b568b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-723514ee-0dca-4d76-884a-76c2e393bab3', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ab9b52-c618-4130-8a67-a2826ef03fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:13 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Volume volume-723514ee-0dca-4d76-884a-76c2e393bab3 (723514ee-0dca-4d76-884a-76c2e393bab3): created successfully Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ab9b52-c618-4130-8a67-a2826ef03fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Flow 'volume_create_manager' (2ecdd8bf-d38c-4d51-80d4-a3cbee97e26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:13 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-b974122d-eb66-4cbd-a5b3-90f0f73ae004 tempest-ProjectReaderTests-790087695 None] Created volume successfully. Jul 15 18:50:13 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9.ac72e4c6-7c7c-4f57-b763-fc83913fe336" returned: 0 in 0.277s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-ac72e4c6-7c7c-4f57-b763-fc83913fe336" released by "_delete_snapshot" :: held 1.508s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-d36cc943-1010-4e86-a0eb-79338b7ddbd9" released by "delete_snapshot" :: held 1.532s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Created reservations ['d8cef2f6-39c9-477d-aab5-cf2383496910', 'ffb059bc-883a-402e-aecf-a4ec6f4a6f35', 'd8258b81-f764-4f4f-bb71-0c56e0c85967', '018baeef-5fc4-4759-9235-852df3bba9d1'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:13 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Delete snapshot completed successfully. Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-85dc97d3-ee5e-4844-9818-8975caa44e3d tempest-ProjectMemberTests-183694055 None] Lock "cinder-ac72e4c6-7c7c-4f57-b763-fc83913fe336-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Creating offline snapshot 4b139aae-a5e3-40ab-ad4e-3420ee6565e0 of volume 723514ee-0dca-4d76-884a-76c2e393bab3 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c584259-b3e3-463b-b049-e61ad15f228f]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:13 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 Jul 15 18:50:13 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-d36cc943-1010-4e86-a0eb-79338b7ddbd9-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Lock "cinder-d36cc943-1010-4e86-a0eb-79338b7ddbd9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-d36cc943-1010-4e86-a0eb-79338b7ddbd9" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-d36cc943-1010-4e86-a0eb-79338b7ddbd9" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:14 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3" returned: 0 in 0.388s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[497cf4d3-9061-4dd4-b955-334dae945dd3]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:14 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 1G Jul 15 18:50:14 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:14 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 Jul 15 18:50:14 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:14 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 1G" returned: 0 in 0.386s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-723514ee-0dca-4d76-884a-76c2e393bab3 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:14 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9" returned: 0 in 0.388s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:14 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-723514ee-0dca-4d76-884a-76c2e393bab3 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 Jul 15 18:50:14 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:14 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9 Jul 15 18:50:14 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:14 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-d36cc943-1010-4e86-a0eb-79338b7ddbd9" returned: 0 in 0.249s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-d36cc943-1010-4e86-a0eb-79338b7ddbd9" released by "delete_volume" :: held 0.707s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:14 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-723514ee-0dca-4d76-884a-76c2e393bab3 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0" returned: 0 in 0.323s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:14 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 is being set with open permissions: ugo+rw Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Created reservations ['4f041f24-d1d1-4b28-a090-f7e95f7b28d0', '0bf134c2-69aa-4f7d-9fdf-216dc3ca42db', 'af16300f-9cb2-4f8c-9f30-f1f42ddfccdd', '9ed99cd7-5c00-48ad-81a7-e5d72e99fa60'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:14 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 Jul 15 18:50:14 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:14 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:14 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:15 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:15 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.info Jul 15 18:50:15 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:15 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.253s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:15 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Deleted volume successfully. Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-130b3787-d7af-48a5-a459-a735daa800a3 tempest-ProjectMemberTests-183694055 None] Lock "cinder-d36cc943-1010-4e86-a0eb-79338b7ddbd9-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:15 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.info" returned: 0 in 0.271s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:15 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.info is being set with open permissions: ugo+rw Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:15 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.info Jul 15 18:50:15 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:15 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (82a87b1a-8268-4da7-9f4d-7e0d73985724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6213bad-2cc2-4bf5-adc3-71768fe9b0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.info" returned: 0 in 0.292s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6213bad-2cc2-4bf5-adc3-71768fe9b0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1467712522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:16Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d63e9a8-fdf2-4cae-bbb4-d27c74f74e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d63e9a8-fdf2-4cae-bbb4-d27c74f74e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799f65aa-b6ff-48c9-a8af-de13eb1161af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799f65aa-b6ff-48c9-a8af-de13eb1161af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8', 'volume_name': 'volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b29ad5-3142-4e84-8753-3a042cb74e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b29ad5-3142-4e84-8753-3a042cb74e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4814f5fa-40d1-464d-9bc5-0965ca2bf6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:15 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Volume 9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8', 'volume_size': 1} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1467712522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:16Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Creating volume 9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:15 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:15 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 1073741824 Jul 15 18:50:15 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:15 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-e5e55465-6ef0-43d8-9a7b-7d77a0c44ad3 tempest-ProjectReaderTests-790087695 None] Create snapshot completed successfully Jul 15 18:50:16 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 1073741824" returned: 0 in 0.395s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:16 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 Jul 15 18:50:16 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:16 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" returned: 0 in 0.242s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4814f5fa-40d1-464d-9bc5-0965ca2bf6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd6f574-0029-4c29-be8c-7d38bab78f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:16 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Volume volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 (9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8): created successfully Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd6f574-0029-4c29-be8c-7d38bab78f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (82a87b1a-8268-4da7-9f4d-7e0d73985724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:16 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f0b2f629-3b26-499d-939b-01e169288c7a tempest-ProjectMemberTests-183694055 None] Created volume successfully. Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Creating offline snapshot bb01f0c3-242b-43cd-8125-9eb578f5fa07 of volume 9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7fb4c5-d240-4943-936b-fe39fca6c482]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-4b139aae-a5e3-40ab-ad4e-3420ee6565e0-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Lock "cinder-4b139aae-a5e3-40ab-ad4e-3420ee6565e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-723514ee-0dca-4d76-884a-76c2e393bab3" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-723514ee-0dca-4d76-884a-76c2e393bab3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-4b139aae-a5e3-40ab-ad4e-3420ee6565e0" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-4b139aae-a5e3-40ab-ad4e-3420ee6565e0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Deleting offline snapshot 4b139aae-a5e3-40ab-ad4e-3420ee6565e0 of volume 723514ee-0dca-4d76-884a-76c2e393bab3 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] snapshot_file for this snap is: volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:50:16 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 Jul 15 18:50:16 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[125b10bc-ed6f-4f06-92cb-64958343efcd]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:16 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:17 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 Jul 15 18:50:17 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:17 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" returned: 0 in 0.374s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:17 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 1G Jul 15 18:50:17 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:17 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0" returned: 0 in 0.387s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-723514ee-0dca-4d76-884a-76c2e393bab3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2edd44c-4fe3-4ffa-bf30-29884b284341]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:17 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 Jul 15 18:50:17 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:17 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 1G" returned: 0 in 0.368s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:17 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 Jul 15 18:50:17 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:17 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3" returned: 0 in 0.406s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:17 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 Jul 15 18:50:17 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:17 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07" returned: 0 in 0.295s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:17 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 is being set with open permissions: ugo+rw Jul 15 18:50:17 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:17 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 Jul 15 18:50:17 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:18 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0" returned: 0 in 0.346s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:18 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07" returned: 0 in 0.272s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:18 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0 Jul 15 18:50:18 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:18 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.info Jul 15 18:50:18 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:18 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3.4b139aae-a5e3-40ab-ad4e-3420ee6565e0" returned: 0 in 0.245s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-4b139aae-a5e3-40ab-ad4e-3420ee6565e0" released by "_delete_snapshot" :: held 1.477s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-723514ee-0dca-4d76-884a-76c2e393bab3" released by "delete_snapshot" :: held 1.501s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:18 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.info" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:18 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.info is being set with open permissions: ugo+rw Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:18 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.info Jul 15 18:50:18 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Created reservations ['3a34b54d-9ba4-4c2f-8191-d76514adca37', 'c9d0f370-8856-49ab-bffb-1eba6eef253b', '922ab20b-f6ef-4f8a-9d04-d02a814dbd2c', 'd3d3f6d1-e4c7-48db-a541-a4f011fa28d5'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:18 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Delete snapshot completed successfully. Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-5baea806-7354-4061-a4ea-1b51e01cebfa tempest-ProjectReaderTests-790087695 None] Lock "cinder-4b139aae-a5e3-40ab-ad4e-3420ee6565e0-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:18 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.info" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:18 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-5cb5348a-944e-422d-bc3a-3e9bd393e9fb tempest-ProjectMemberTests-183694055 None] Create snapshot completed successfully Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-bb01f0c3-242b-43cd-8125-9eb578f5fa07-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Lock "cinder-bb01f0c3-242b-43cd-8125-9eb578f5fa07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:18 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-bb01f0c3-242b-43cd-8125-9eb578f5fa07" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-bb01f0c3-242b-43cd-8125-9eb578f5fa07" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Deleting offline snapshot bb01f0c3-242b-43cd-8125-9eb578f5fa07 of volume 9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] snapshot_file for this snap is: volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adf9a1c-6190-434f-85a4-f087c7fb2f26]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-723514ee-0dca-4d76-884a-76c2e393bab3-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Lock "cinder-723514ee-0dca-4d76-884a-76c2e393bab3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-723514ee-0dca-4d76-884a-76c2e393bab3" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-723514ee-0dca-4d76-884a-76c2e393bab3" acquired by "delete_volume" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:19 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 Jul 15 18:50:19 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[07989746-3225-426e-8c9a-1371cb9a4608]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:19 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 Jul 15 18:50:19 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:19 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07" returned: 0 in 0.387s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57f490-c326-4642-87bc-02fcb7d295cf]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:19 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3" returned: 0 in 0.380s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:19 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 Jul 15 18:50:19 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:19 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3 Jul 15 18:50:19 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:19 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-723514ee-0dca-4d76-884a-76c2e393bab3" returned: 0 in 0.247s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:19 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" returned: 0 in 0.374s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-723514ee-0dca-4d76-884a-76c2e393bab3" released by "delete_volume" :: held 0.699s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:19 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 Jul 15 18:50:19 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Created reservations ['04a3e8cf-ad9c-4c7a-a484-57397089c767', '3733fcf3-5d53-4b27-9cfc-61634719efcd', 'c716e1cd-bf19-48f4-a70e-ceaa587b48c7', 'd32511ff-e055-4745-be99-b49ba8b6d51c'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:19 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:20 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:20 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:20 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07" returned: 0 in 0.338s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:20 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07 Jul 15 18:50:20 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:20 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.295s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Deleted volume successfully. Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-69391686-3bea-4d5e-8040-5c0b7e7282cb tempest-ProjectReaderTests-790087695 None] Lock "cinder-723514ee-0dca-4d76-884a-76c2e393bab3-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:20 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8.bb01f0c3-242b-43cd-8125-9eb578f5fa07" returned: 0 in 0.250s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-bb01f0c3-242b-43cd-8125-9eb578f5fa07" released by "_delete_snapshot" :: held 1.444s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" released by "delete_snapshot" :: held 1.470s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Created reservations ['f555862b-6644-4d31-a8dd-20f955c78c85', 'c073fe2a-a7ba-48a6-8d78-4584401f1c90', 'f3522d0b-2208-46ea-9e1d-1bb962511df0', '806e93dc-e09f-4e3f-8869-4df28f4f72f6'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:20 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Delete snapshot completed successfully. Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-07b7d00c-364c-4f73-a15c-347e13599053 tempest-ProjectMemberTests-183694055 None] Lock "cinder-bb01f0c3-242b-43cd-8125-9eb578f5fa07-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Flow 'volume_create_manager' (8ac24077-72fa-4786-a30d-46dbbdb4a7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e96e02-239b-49ce-9a80-dbc2bdf0f259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e96e02-239b-49ce-9a80-dbc2bdf0f259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877928347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837c9b0b-ff04-46d1-a6cf-244d566fbaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d432b72ff5fc4417aa9c41774488cf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:21Z,use_quota=True,user_id='87725c10c668437ba756d9956bd5d45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d3aacf-53c5-4812-ba0a-703259dda3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d3aacf-53c5-4812-ba0a-703259dda3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47726f87-8538-423a-a185-7d19627e0c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47726f87-8538-423a-a185-7d19627e0c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837c9b0b-ff04-46d1-a6cf-244d566fbaf5', 'volume_name': 'volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d57b61-8caf-4c94-a089-622e75f8e681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d57b61-8caf-4c94-a089-622e75f8e681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d473e239-c585-405c-ad14-6cfb5a04d263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:20 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Volume 837c9b0b-ff04-46d1-a6cf-244d566fbaf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5', 'volume_size': 1} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877928347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837c9b0b-ff04-46d1-a6cf-244d566fbaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d432b72ff5fc4417aa9c41774488cf10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:21Z,use_quota=True,user_id='87725c10c668437ba756d9956bd5d45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Creating volume 837c9b0b-ff04-46d1-a6cf-244d566fbaf5 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:20 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:20 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:20 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 1073741824 Jul 15 18:50:20 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Lock "cinder-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a17ac07-3214-411b-be13-3af0a2406f4a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:21 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 1073741824" returned: 0 in 0.445s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:21 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 Jul 15 18:50:21 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:21 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 Jul 15 18:50:21 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:21 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" returned: 0 in 0.266s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d473e239-c585-405c-ad14-6cfb5a04d263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c767801d-2601-4a45-bd68-0daf4e4d299a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:21 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" returned: 0 in 0.377s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:21 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Volume volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 (837c9b0b-ff04-46d1-a6cf-244d566fbaf5): created successfully Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c767801d-2601-4a45-bd68-0daf4e4d299a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:21 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8 Jul 15 18:50:21 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Flow 'volume_create_manager' (8ac24077-72fa-4786-a30d-46dbbdb4a7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:21 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-3991a62f-784f-4ff8-86d4-f3dc60c12792 tempest-ProjectReaderTests-790087695 None] Created volume successfully. Jul 15 18:50:21 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" returned: 0 in 0.301s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8" released by "delete_volume" :: held 0.742s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Creating offline snapshot f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 of volume 837c9b0b-ff04-46d1-a6cf-244d566fbaf5 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66188b6-1347-4b6a-aec3-413ac84b936a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:21 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Created reservations ['99c14bd2-ab1a-4d75-b170-28ef09ca4a97', '5c4a9a77-e8e1-490f-ad78-b070db8509a0', '40734338-40bd-489e-a0b9-ffa881b73d45', 'bd7a354e-ac7b-4742-af13-b0e84ed3a97a'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:22 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 Jul 15 18:50:22 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:22 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:22 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:22 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.257s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:22 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Deleted volume successfully. Jul 15 18:50:22 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-97ef395e-ae43-4e8b-8c36-7e69be553a73 tempest-ProjectMemberTests-183694055 None] Lock "cinder-9dc2ca7e-6cd1-4ea8-ab78-b1e7a7c295b8-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" returned: 0 in 0.386s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:22 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 1G Jul 15 18:50:22 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:22 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (379f790f-da4f-415e-8fd2-704ff3782ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acf4d42-86a1-443a-964b-ee458dc651e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 1G" returned: 0 in 0.469s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acf4d42-86a1-443a-964b-ee458dc651e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595638874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33ca0be-2030-4961-bc49-a7d8eecf3e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:23Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:22 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 Jul 15 18:50:22 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bc2098-993a-4bfc-870b-61dd3d51c889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bc2098-993a-4bfc-870b-61dd3d51c889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a15331-2b05-4188-b5dc-83a9fa0ebee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a15331-2b05-4188-b5dc-83a9fa0ebee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33ca0be-2030-4961-bc49-a7d8eecf3e8e', 'volume_name': 'volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a95720-6885-4296-b0d3-78d6e4a10d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a95720-6885-4296-b0d3-78d6e4a10d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2f16de-e26f-4b90-921c-607b83c6e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:22 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Volume b33ca0be-2030-4961-bc49-a7d8eecf3e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e', 'volume_size': 1} Jul 15 18:50:22 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:23 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04" returned: 0 in 0.278s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:23 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 is being set with open permissions: ugo+rw Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:23 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 Jul 15 18:50:23 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:23 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04" returned: 0 in 0.247s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:23 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.info Jul 15 18:50:23 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:23 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.info" returned: 0 in 0.238s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:23 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.info is being set with open permissions: ugo+rw Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:23 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.info Jul 15 18:50:23 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:23 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.info" returned: 0 in 0.233s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.977s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595638874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33ca0be-2030-4961-bc49-a7d8eecf3e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:23Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Creating volume b33ca0be-2030-4961-bc49-a7d8eecf3e8e {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:23 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:23 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:23 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e 1073741824 Jul 15 18:50:23 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:23 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f1de1a52-5e2f-4209-a943-25000db86399 tempest-ProjectReaderTests-790087695 None] Create snapshot completed successfully Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Lock "cinder-f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Deleting offline snapshot f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 of volume 837c9b0b-ff04-46d1-a6cf-244d566fbaf5 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] snapshot_file for this snap is: volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1344cb65-04bb-47f9-98a8-8c4c60b25093]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:24 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 Jul 15 18:50:24 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:24 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e 1073741824" returned: 0 in 0.427s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:24 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e Jul 15 18:50:24 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:24 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04" returned: 0 in 0.354s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f58529-3981-4e7f-9527-f611e4f5c509]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:24 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" returned: 0 in 0.244s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2f16de-e26f-4b90-921c-607b83c6e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa423f83-4421-4042-8630-cc95c656ea19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:24 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 Jul 15 18:50:24 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:24 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Volume volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e (b33ca0be-2030-4961-bc49-a7d8eecf3e8e): created successfully Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa423f83-4421-4042-8630-cc95c656ea19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (379f790f-da4f-415e-8fd2-704ff3782ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:24 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c2d818f0-fe0c-4b9a-8b7b-6f79fc072606 tempest-ProjectMemberTests-183694055 None] Created volume successfully. Jul 15 18:50:24 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" returned: 0 in 0.360s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:24 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:24 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 Jul 15 18:50:24 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Creating offline snapshot 1f077b2f-b270-42f1-a2d8-058176cf92be of volume b33ca0be-2030-4961-bc49-a7d8eecf3e8e {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[695f1bf5-cef9-4a09-b1c3-d36ddcfc42f8]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:25 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e Jul 15 18:50:25 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:25 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04" returned: 0 in 0.328s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:25 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04 Jul 15 18:50:25 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:25 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" returned: 0 in 0.360s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:25 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be 1G Jul 15 18:50:25 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:25 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5.f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04" returned: 0 in 0.257s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04" released by "_delete_snapshot" :: held 1.390s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" released by "delete_snapshot" :: held 1.416s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Created reservations ['c202e4ed-ef5c-4963-9bac-3cf6f5310ea0', '25616ee0-5c7b-4ba6-ba83-88c485f5aaad', 'cc184bdb-bfbd-4ed8-9ab8-2b03db96c5a8', '4d73f301-314f-4c6a-9f79-d75fc980056d'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:25 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Delete snapshot completed successfully. Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-c9db0324-9221-451d-98a6-cca96ab69120 tempest-ProjectReaderTests-790087695 None] Lock "cinder-f8ae44ec-7bc3-4a4b-b7d3-aa02d69cbe04-delete_snapshot" released by "delete_snapshot" :: held 1.554s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:25 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be 1G" returned: 0 in 0.390s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:25 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:25 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be Jul 15 18:50:25 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:26 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be" returned: 0 in 0.280s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:26 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be is being set with open permissions: ugo+rw Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:26 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be Jul 15 18:50:26 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-837c9b0b-ff04-46d1-a6cf-244d566fbaf5-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Lock "cinder-837c9b0b-ff04-46d1-a6cf-244d566fbaf5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:26 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be" returned: 0 in 0.246s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Acquiring lock "cinder-quobyte-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" acquired by "delete_volume" :: waited 0.020s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2696aa6-3fe7-4615-b006-a4014358dfd3]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:26 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.info Jul 15 18:50:26 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:26 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 Jul 15 18:50:26 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:26 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.info" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:26 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.info is being set with open permissions: ugo+rw Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:26 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.info Jul 15 18:50:26 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:26 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" returned: 0 in 0.355s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:26 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5 Jul 15 18:50:26 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:26 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.info" returned: 0 in 0.245s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:26 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-54fb1e24-3dd8-4862-bd5f-e1c27ef8576a tempest-ProjectMemberTests-183694055 None] Create snapshot completed successfully Jul 15 18:50:26 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:26 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" returned: 0 in 0.252s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Lock "cinder-quobyte-837c9b0b-ff04-46d1-a6cf-244d566fbaf5" released by "delete_volume" :: held 0.670s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Created reservations ['792590e0-df72-4526-9288-74c2efe0dedf', '93939ada-683c-4f75-a41a-56482ff93f8d', 'da315919-8a4c-4d3b-ab14-8305e3e43fbb', 'a1ba6bcd-6387-4341-92cb-4e95fb0c8af4'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-1f077b2f-b270-42f1-a2d8-058176cf92be-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:27 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:27 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Lock "cinder-1f077b2f-b270-42f1-a2d8-058176cf92be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-1f077b2f-b270-42f1-a2d8-058176cf92be" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-1f077b2f-b270-42f1-a2d8-058176cf92be" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Deleting offline snapshot 1f077b2f-b270-42f1-a2d8-058176cf92be of volume b33ca0be-2030-4961-bc49-a7d8eecf3e8e {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] snapshot_file for this snap is: volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e84eb0-8ec4-4199-8652-60fddfd2db93]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:27 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be Jul 15 18:50:27 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:27 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:27 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Deleted volume successfully. Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-254c4418-91e1-4503-8787-317bd024f89f tempest-ProjectReaderTests-790087695 None] Lock "cinder-837c9b0b-ff04-46d1-a6cf-244d566fbaf5-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:27 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be" returned: 0 in 0.377s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a561441-024c-436c-8be0-5c91421929ec]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:27 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e Jul 15 18:50:27 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:27 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:27 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" returned: 0 in 0.363s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:28 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be Jul 15 18:50:28 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:28 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be" returned: 0 in 0.362s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:28 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be Jul 15 18:50:28 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:28 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:28 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e.1f077b2f-b270-42f1-a2d8-058176cf92be" returned: 0 in 0.254s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-1f077b2f-b270-42f1-a2d8-058176cf92be" released by "_delete_snapshot" :: held 1.448s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" released by "delete_snapshot" :: held 1.470s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:28 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Created reservations ['61aa2640-88d0-4a8e-9b4d-163b28d51481', 'ab10dde9-7206-47d4-a4d1-4a84231f8abf', 'f673225f-8321-47cd-85a5-5b521278bc0a', '35a0515c-5e2e-4393-bd38-72d120a395c8'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:28 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Delete snapshot completed successfully. Jul 15 18:50:28 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-8a79d995-905a-4523-9344-b72c482996b4 tempest-ProjectMemberTests-183694055 None] Lock "cinder-1f077b2f-b270-42f1-a2d8-058176cf92be-delete_snapshot" released by "delete_snapshot" :: held 1.615s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-b33ca0be-2030-4961-bc49-a7d8eecf3e8e-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Lock "cinder-b33ca0be-2030-4961-bc49-a7d8eecf3e8e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:29 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" acquired by "delete_volume" :: waited 0.017s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:29 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b2ef82-ab52-4915-90b0-f90bb4e71fdc]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:29 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e Jul 15 18:50:29 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:29 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" returned: 0 in 0.375s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:29 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:29 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e Jul 15 18:50:29 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:30 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" returned: 0 in 0.238s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-b33ca0be-2030-4961-bc49-a7d8eecf3e8e" released by "delete_volume" :: held 0.683s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Created reservations ['c23fc388-4c51-4295-8d2f-8ea8da012d06', 'e9645441-3db9-4545-91d5-4ff39c8a81a7', '5bea2f2d-5f19-45fe-9d31-b088ba878301', 'f4f709b6-4671-4402-a3f1-77a70c953ee6'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:30 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:30 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:30 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:30 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Deleted volume successfully. Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-4720229b-72c8-4fed-9df8-aae5efa341fa tempest-ProjectMemberTests-183694055 None] Lock "cinder-b33ca0be-2030-4961-bc49-a7d8eecf3e8e-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (de4af27c-b796-4cdc-ab2a-5b64f2fdfcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b983e3e-ba22-4e96-ad18-b24a7b6fd239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:30 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b983e3e-ba22-4e96-ad18-b24a7b6fd239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1609988431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b763db59-a8c2-4492-9aa2-65efd02b3882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:31Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9d511f-1e9f-447f-9eb8-af857efae326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9d511f-1e9f-447f-9eb8-af857efae326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a639ce-c63e-4590-9122-e9eb3be3aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a639ce-c63e-4590-9122-e9eb3be3aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b763db59-a8c2-4492-9aa2-65efd02b3882', 'volume_name': 'volume-b763db59-a8c2-4492-9aa2-65efd02b3882', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63197e3-07d2-4001-9e3d-e9738e8d0264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63197e3-07d2-4001-9e3d-e9738e8d0264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700c7bd9-2fbf-4e82-a92e-eff93af2f672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:31 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Volume b763db59-a8c2-4492-9aa2-65efd02b3882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b763db59-a8c2-4492-9aa2-65efd02b3882', 'volume_size': 1} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1609988431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b763db59-a8c2-4492-9aa2-65efd02b3882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:31Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Creating volume b763db59-a8c2-4492-9aa2-65efd02b3882 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:31 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:31 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 1073741824 Jul 15 18:50:31 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:31 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 1073741824" returned: 0 in 0.423s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:31 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 Jul 15 18:50:31 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:31 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882" returned: 0 in 0.230s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700c7bd9-2fbf-4e82-a92e-eff93af2f672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b763db59-a8c2-4492-9aa2-65efd02b3882', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b848aa67-6c20-42ac-9aeb-9ebcbbff784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:31 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Volume volume-b763db59-a8c2-4492-9aa2-65efd02b3882 (b763db59-a8c2-4492-9aa2-65efd02b3882): created successfully Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b848aa67-6c20-42ac-9aeb-9ebcbbff784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:31 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (de4af27c-b796-4cdc-ab2a-5b64f2fdfcbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:31 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1704428c-6b58-460c-a53a-57a10ffbf988 tempest-ProjectMemberTests-183694055 None] Created volume successfully. Jul 15 18:50:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:32 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Creating offline snapshot 5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 of volume b763db59-a8c2-4492-9aa2-65efd02b3882 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:32 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e672cc-30f4-42ad-811b-2665f5f526ad]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:32 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 Jul 15 18:50:32 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:32 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882" returned: 0 in 0.384s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:32 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 1G Jul 15 18:50:32 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:32 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 1G" returned: 0 in 0.437s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:32 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b763db59-a8c2-4492-9aa2-65efd02b3882 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:32 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b763db59-a8c2-4492-9aa2-65efd02b3882 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 Jul 15 18:50:32 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:33 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b763db59-a8c2-4492-9aa2-65efd02b3882 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7" returned: 0 in 0.310s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:33 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 is being set with open permissions: ugo+rw Jul 15 18:50:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:33 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 Jul 15 18:50:33 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:33 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7" returned: 0 in 0.240s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:33 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.info Jul 15 18:50:33 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:33 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.info" returned: 0 in 0.238s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:33 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.info is being set with open permissions: ugo+rw Jul 15 18:50:33 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:33 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.info Jul 15 18:50:33 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:34 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.info" returned: 0 in 0.236s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:34 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-c00631c3-5b64-4226-a978-96c83c09d587 tempest-ProjectMemberTests-183694055 None] Create snapshot completed successfully Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Lock "cinder-5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-b763db59-a8c2-4492-9aa2-65efd02b3882" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-b763db59-a8c2-4492-9aa2-65efd02b3882" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Deleting offline snapshot 5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 of volume b763db59-a8c2-4492-9aa2-65efd02b3882 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] snapshot_file for this snap is: volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fc4998-038a-44a9-b4b8-40e1bbefea62]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:34 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 Jul 15 18:50:34 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:34 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7" returned: 0 in 0.374s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b763db59-a8c2-4492-9aa2-65efd02b3882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[326b46c9-5da4-42e8-ae99-708d64ea451e]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:34 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:34 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 Jul 15 18:50:34 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:35 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882" returned: 0 in 0.363s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:35 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 Jul 15 18:50:35 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:35 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:35 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:35 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7" returned: 0 in 0.359s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:35 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.294s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:50:35 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7 Jul 15 18:50:35 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:35 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882.5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7" returned: 0 in 0.279s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7" released by "_delete_snapshot" :: held 1.486s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-b763db59-a8c2-4492-9aa2-65efd02b3882" released by "delete_snapshot" :: held 1.513s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Created reservations ['ffd7584d-2b48-4e89-bbe2-bf8d9a01a542', '429fa47a-9645-4650-b11a-35f3110cc4b2', '562da494-1caa-4187-b1fe-5cd2ef57276a', 'ea520f20-ffc4-423a-bfaa-6eb347597277'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:35 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Delete snapshot completed successfully. Jul 15 18:50:35 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-1456731a-ed5a-41e9-a5ab-564b2cdd21e2 tempest-ProjectMemberTests-183694055 None] Lock "cinder-5c5a9ce7-a9ed-41e5-aa9c-c7d93bc0c3b7-delete_snapshot" released by "delete_snapshot" :: held 1.650s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-b763db59-a8c2-4492-9aa2-65efd02b3882-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Lock "cinder-b763db59-a8c2-4492-9aa2-65efd02b3882-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-b763db59-a8c2-4492-9aa2-65efd02b3882" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:36 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-b763db59-a8c2-4492-9aa2-65efd02b3882" acquired by "delete_volume" :: waited 0.028s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:36 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cd3278-6487-4804-89a1-f61f614ab22c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:36 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:36 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 Jul 15 18:50:36 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:36 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:36 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882" returned: 0 in 0.371s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:36 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:37 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b763db59-a8c2-4492-9aa2-65efd02b3882" returned: 0 in 0.267s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-b763db59-a8c2-4492-9aa2-65efd02b3882" released by "delete_volume" :: held 0.706s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Created reservations ['d75a9ed6-b3b2-4edb-a738-fcad2927b464', 'ce02f7d2-5b17-422f-8a81-f0c76e1a5ffb', '6accf87a-9d68-4766-95d3-b071fc850753', '02e85484-974d-4295-b644-516c9e610e4f'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:37 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:37 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:37 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.258s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:37 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Deleted volume successfully. Jul 15 18:50:37 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-f5e0243c-644f-4146-a81e-b9715bf1833a tempest-ProjectMemberTests-183694055 None] Lock "cinder-b763db59-a8c2-4492-9aa2-65efd02b3882-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (f0ec5aff-bc18-4049-b353-eeb443bce19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d989c34-5a99-4e71-aee8-7d041a5e36c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d989c34-5a99-4e71-aee8-7d041a5e36c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608617776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d7e9f9-f1e7-41f5-8939-5980d91e0dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:38Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2815c9ae-bfc1-45b5-81ef-5d4bfc1ff9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2815c9ae-bfc1-45b5-81ef-5d4bfc1ff9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9975726-67bc-4860-afe6-842495226a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9975726-67bc-4860-afe6-842495226a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d7e9f9-f1e7-41f5-8939-5980d91e0dd5', 'volume_name': 'volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984c1cd0-4bdd-42af-88b7-7242353bc91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984c1cd0-4bdd-42af-88b7-7242353bc91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20aab899-b0af-484a-b845-044ea79ab389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:38 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Volume 26d7e9f9-f1e7-41f5-8939-5980d91e0dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5', 'volume_size': 1} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608617776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d7e9f9-f1e7-41f5-8939-5980d91e0dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc8545fc17407ebba83965e25b7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:38Z,use_quota=True,user_id='8b9d27bace52435fbfeabcc2eb32746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Creating volume 26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:38 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:38 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 1073741824 Jul 15 18:50:38 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:38 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 1073741824" returned: 0 in 0.466s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:38 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 Jul 15 18:50:38 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:38 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" returned: 0 in 0.268s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:38 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20aab899-b0af-484a-b845-044ea79ab389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1cd4a7-6cf1-4555-9689-19ca233f7532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:39 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Volume volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 (26d7e9f9-f1e7-41f5-8939-5980d91e0dd5): created successfully Jul 15 18:50:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1cd4a7-6cf1-4555-9689-19ca233f7532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:39 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Flow 'volume_create_manager' (f0ec5aff-bc18-4049-b353-eeb443bce19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:39 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-0a01efc6-75f1-4cc8-b20e-3fa8469cc7d4 tempest-ProjectMemberTests-183694055 None] Created volume successfully. Jul 15 18:50:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:39 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Creating offline snapshot c9f20577-e257-4252-96cf-0960889dafa0 of volume 26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:39 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4238e03b-5693-4422-97a7-745e914b87a3]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:39 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 Jul 15 18:50:39 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:39 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" returned: 0 in 0.397s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:39 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:39 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 1G Jul 15 18:50:39 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:40 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 1G" returned: 0 in 0.430s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:40 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 Jul 15 18:50:40 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:40 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0" returned: 0 in 0.304s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:40 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 is being set with open permissions: ugo+rw Jul 15 18:50:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:40 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 Jul 15 18:50:40 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:40 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0" returned: 0 in 0.263s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:40 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:40 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.info Jul 15 18:50:40 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:41 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.info" returned: 0 in 0.277s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:41 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.info is being set with open permissions: ugo+rw Jul 15 18:50:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:41 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.info Jul 15 18:50:41 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:41 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.info" returned: 0 in 0.251s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:41 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:41 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-f115d28c-3bde-43a7-a1b9-498517c44ca3 tempest-ProjectMemberTests-183694055 None] Create snapshot completed successfully Jul 15 18:50:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-c9f20577-e257-4252-96cf-0960889dafa0-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Lock "cinder-c9f20577-e257-4252-96cf-0960889dafa0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-c9f20577-e257-4252-96cf-0960889dafa0" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:42 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-c9f20577-e257-4252-96cf-0960889dafa0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Deleting offline snapshot c9f20577-e257-4252-96cf-0960889dafa0 of volume 26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:50:42 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] snapshot_file for this snap is: volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:50:42 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95555fd-8ebb-48a7-a093-7f7da30555a2]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:42 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:42 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 Jul 15 18:50:42 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:43 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0" returned: 0 in 0.515s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:43 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:43 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e1fc6a-b957-460f-92a7-c8394701e0f7]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:43 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 Jul 15 18:50:43 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:43 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" returned: 0 in 0.448s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:43 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:43 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 Jul 15 18:50:43 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:44 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0" returned: 0 in 0.390s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:44 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0 Jul 15 18:50:44 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:44 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5.c9f20577-e257-4252-96cf-0960889dafa0" returned: 0 in 0.274s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-c9f20577-e257-4252-96cf-0960889dafa0" released by "_delete_snapshot" :: held 1.777s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" released by "delete_snapshot" :: held 1.810s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=206,cinder:UPDATE=266,cinder:INSERT=59,cinder:DELETE=16 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Created reservations ['b191df00-72a4-44f3-b79a-4903bf9f6fab', '11a353d9-d980-4766-929a-2b1fa2216a2b', '6c1e45e7-3183-472b-a8d9-c4d61f55418d', 'fe416ec1-34ca-41b1-ab89-f3a7012f1815'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:44 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Delete snapshot completed successfully. Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-487c1ef2-e042-4ed4-8b3e-4923b79e0ae7 tempest-ProjectMemberTests-183694055 None] Lock "cinder-c9f20577-e257-4252-96cf-0960889dafa0-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Lock "cinder-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Acquiring lock "cinder-quobyte-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ba1265-cc01-4b7d-b72d-c9f0752f7c78]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:44 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:45 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 Jul 15 18:50:45 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:45 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" returned: 0 in 0.446s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:45 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5 Jul 15 18:50:45 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:45 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" returned: 0 in 0.264s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Lock "cinder-quobyte-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5" released by "delete_volume" :: held 0.774s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Created reservations ['2bb4b776-c2d0-434c-a31d-722969a55bbe', 'fa4d9618-9c73-4da6-88b5-cab8a2ad63ce', '881d74e7-c961-4433-af2a-4fff1a4a52a3', '181e5d06-e4eb-40c3-b6c4-cf4db5176bc3'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:45 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:45 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:45 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:46 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:46 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.273s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:46 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:46 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Deleted volume successfully. Jul 15 18:50:46 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-eb4f45a2-ceff-4273-9bd5-cee5e19898e0 tempest-ProjectMemberTests-183694055 None] Lock "cinder-26d7e9f9-f1e7-41f5-8939-5980d91e0dd5-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Flow 'volume_create_manager' (4ecc8f96-c848-4b88-b591-aaf049ec046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc27b73-1428-4b75-8dfe-d2ade42c8f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc27b73-1428-4b75-8dfe-d2ade42c8f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616514141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c8eadd-9d53-4d05-8782-7dc2fcf910d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5e73ce42a148ab844a1fe3107f6562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:50Z,use_quota=True,user_id='6012438d66254f6ba97904fa1271a8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f73e36-2495-4ce7-a7a7-5ddb1a01c5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f73e36-2495-4ce7-a7a7-5ddb1a01c5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4808db4e-3c9b-4a3e-bee0-fde7da80f05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4808db4e-3c9b-4a3e-bee0-fde7da80f05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c8eadd-9d53-4d05-8782-7dc2fcf910d1', 'volume_name': 'volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c692af2-dc2f-4696-bdbb-71372ca4f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c692af2-dc2f-4696-bdbb-71372ca4f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9949531-d94b-4913-b6b6-7049d96bd01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:49 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Volume c8c8eadd-9d53-4d05-8782-7dc2fcf910d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1', 'volume_size': 1} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616514141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c8eadd-9d53-4d05-8782-7dc2fcf910d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5e73ce42a148ab844a1fe3107f6562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:50Z,use_quota=True,user_id='6012438d66254f6ba97904fa1271a8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Creating volume c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:49 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:49 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:50 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 1073741824 Jul 15 18:50:50 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:50 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 1073741824" returned: 0 in 0.457s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:50 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 Jul 15 18:50:50 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:50 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1" returned: 0 in 0.404s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:50 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:50 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9949531-d94b-4913-b6b6-7049d96bd01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e1cded-082b-4ccd-8d93-93d68b5069c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:50 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Volume volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 (c8c8eadd-9d53-4d05-8782-7dc2fcf910d1): created successfully Jul 15 18:50:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e1cded-082b-4ccd-8d93-93d68b5069c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:50 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Flow 'volume_create_manager' (4ecc8f96-c848-4b88-b591-aaf049ec046f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:50 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-4a4fa9d7-6f4a-4003-a5b1-a59915b059f7 tempest-ProjectReaderTests-2134809263 None] Created volume successfully. Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Acquiring lock "cinder-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Lock "cinder-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Acquiring lock "cinder-quobyte-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Lock "cinder-quobyte-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1" acquired by "delete_volume" :: waited 0.016s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[533b7cc0-7044-4774-b26a-f4956e5b3af0]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:52 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 Jul 15 18:50:52 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:52 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1" returned: 0 in 0.359s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:52 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1 Jul 15 18:50:52 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:52 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1" returned: 0 in 0.251s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Lock "cinder-quobyte-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1" released by "delete_volume" :: held 0.658s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:52 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Created reservations ['10f12107-8694-4250-8d68-ee5098c332ce', '0ba39586-13f4-4aad-959d-035bb5b42cf3', 'e8cba6ce-8085-49d6-aa85-752f338c4bab', 'db633e0e-f1a6-4d5d-aa2a-71bc44236709'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:53 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:53 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:53 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.288s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:53 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Deleted volume successfully. Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-120f19f4-519d-4551-b8ca-80f29d3d594b tempest-ProjectReaderTests-2134809263 None] Lock "cinder-c8c8eadd-9d53-4d05-8782-7dc2fcf910d1-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Flow 'volume_create_manager' (833d802f-b5b1-459b-acf5-c2c58cdde6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d5cfc8-a050-452e-836f-8230435ae7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d5cfc8-a050-452e-836f-8230435ae7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247424013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a80dad-1562-4107-ab47-760f18eb9126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5e73ce42a148ab844a1fe3107f6562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:54Z,use_quota=True,user_id='6012438d66254f6ba97904fa1271a8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce8234e-4d11-4029-b3e4-e4aed3a442c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce8234e-4d11-4029-b3e4-e4aed3a442c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c55a500-6de1-48ec-bb8e-6a5dc81d2cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c55a500-6de1-48ec-bb8e-6a5dc81d2cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a80dad-1562-4107-ab47-760f18eb9126', 'volume_name': 'volume-05a80dad-1562-4107-ab47-760f18eb9126', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d859eb9-d581-4cce-bf1c-c56b568ce37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d859eb9-d581-4cce-bf1c-c56b568ce37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009ac2c4-19e0-4fc8-84c3-2c5f77437e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:53 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Volume 05a80dad-1562-4107-ab47-760f18eb9126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a80dad-1562-4107-ab47-760f18eb9126', 'volume_size': 1} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247424013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a80dad-1562-4107-ab47-760f18eb9126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5e73ce42a148ab844a1fe3107f6562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:54Z,use_quota=True,user_id='6012438d66254f6ba97904fa1271a8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Creating volume 05a80dad-1562-4107-ab47-760f18eb9126 {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:53 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:53 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:53 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126 1073741824 Jul 15 18:50:53 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:54 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126 1073741824" returned: 0 in 0.466s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:54 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126 Jul 15 18:50:54 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:54 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126" returned: 0 in 0.240s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:54 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:54 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009ac2c4-19e0-4fc8-84c3-2c5f77437e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a80dad-1562-4107-ab47-760f18eb9126', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8390235-f4bf-4e74-8f7f-0b026e953fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:54 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Volume volume-05a80dad-1562-4107-ab47-760f18eb9126 (05a80dad-1562-4107-ab47-760f18eb9126): created successfully Jul 15 18:50:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8390235-f4bf-4e74-8f7f-0b026e953fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:54 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Flow 'volume_create_manager' (833d802f-b5b1-459b-acf5-c2c58cdde6cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:54 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-8fe4606a-63bd-40ae-98c8-0225cb8c772c tempest-ProjectReaderTests-2134809263 None] Created volume successfully. Jul 15 18:50:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Acquiring lock "cinder-05a80dad-1562-4107-ab47-760f18eb9126-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:55 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Lock "cinder-05a80dad-1562-4107-ab47-760f18eb9126-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Acquiring lock "cinder-quobyte-05a80dad-1562-4107-ab47-760f18eb9126" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Lock "cinder-quobyte-05a80dad-1562-4107-ab47-760f18eb9126" acquired by "delete_volume" :: waited 0.033s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4769cf90-7720-4b55-97e3-abfcdef043ba]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:56 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126 Jul 15 18:50:56 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:56 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126" returned: 0 in 0.493s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:56 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126 Jul 15 18:50:56 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:56 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-05a80dad-1562-4107-ab47-760f18eb9126" returned: 0 in 0.255s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Lock "cinder-quobyte-05a80dad-1562-4107-ab47-760f18eb9126" released by "delete_volume" :: held 0.796s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:SELECT=171,cinder:INSERT=73,cinder:UPDATE=223,cinder:DELETE=24 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Created reservations ['30256f75-4a2b-4b2f-91ff-7b23fe35fd75', '56e53ee4-b3a5-4e25-9a3d-cf73849f5277', '7680f60c-a5b7-46cc-ae5e-33d7c3f8ffa2', '24e4fc48-d76d-4ecb-9705-6aeeaabc014c'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:56 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:57 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:50:57 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:57 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Flow 'volume_create_manager' (a56ef71c-3701-45b5-a1ee-f78d09775dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694d9805-1cea-4b74-a8d5-d9059f0116a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.319s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:57 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Deleted volume successfully. Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694d9805-1cea-4b74-a8d5-d9059f0116a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-406974666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51fe64b-d9e0-4417-94af-2db427e4a49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d38cfb5b90443ba8cfd065d618dee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:57Z,use_quota=True,user_id='e5ce1a1859e8456db2b21518e6412701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853770d3-fb2c-49b1-8618-f36ee8f8d4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853770d3-fb2c-49b1-8618-f36ee8f8d4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ade0c80-069c-4482-904d-e532af17359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ade0c80-069c-4482-904d-e532af17359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51fe64b-d9e0-4417-94af-2db427e4a49f', 'volume_name': 'volume-b51fe64b-d9e0-4417-94af-2db427e4a49f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae5cc17-0386-4e25-b9d5-823c744788f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae5cc17-0386-4e25-b9d5-823c744788f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5962a776-a06b-4b71-94e6-15de6bf4489c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:57 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Volume b51fe64b-d9e0-4417-94af-2db427e4a49f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51fe64b-d9e0-4417-94af-2db427e4a49f', 'volume_size': 1} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-406974666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51fe64b-d9e0-4417-94af-2db427e4a49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d38cfb5b90443ba8cfd065d618dee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:57Z,use_quota=True,user_id='e5ce1a1859e8456db2b21518e6412701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)}" {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Creating volume b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:57 devstack cinder-volume[87863]: INFO cinder.volume.drivers.remotefs [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] casted to osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f 1073741824 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:57 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f 1073741824 Jul 15 18:50:57 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-a0ba6d1a-a6a3-4f8c-b881-31104007a715 tempest-ProjectReaderTests-2134809263 None] Lock "cinder-05a80dad-1562-4107-ab47-760f18eb9126-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:57 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f 1073741824" returned: 0 in 0.442s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:57 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:57 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f Jul 15 18:50:57 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:58 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f" returned: 0 in 0.266s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:58 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'} {{(pid=87863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:58 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5962a776-a06b-4b71-94e6-15de6bf4489c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51fe64b-d9e0-4417-94af-2db427e4a49f', 'volume_size': 1}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec91e05-f5f8-4a54-a6f3-bd4640eb3cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:58 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Volume volume-b51fe64b-d9e0-4417-94af-2db427e4a49f (b51fe64b-d9e0-4417-94af-2db427e4a49f): created successfully Jul 15 18:50:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec91e05-f5f8-4a54-a6f3-bd4640eb3cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:58 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Flow 'volume_create_manager' (a56ef71c-3701-45b5-a1ee-f78d09775dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:58 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-374ec77c-ba0e-46a3-a541-9dbcdfe45fc9 tempest-SnapshotDependencyTests-1910091545 None] Created volume successfully. Jul 15 18:50:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:59 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Creating offline snapshot 025400a7-e833-4c63-815b-ab86fe877b1f of volume b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:59 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8363eadc-ad97-4e81-a73b-1fd517aeda2a]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:59 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:59 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f Jul 15 18:50:59 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:00 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f" returned: 0 in 0.388s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f 1G {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:00 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f 1G Jul 15 18:51:00 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:00 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f 1G" returned: 0 in 0.434s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51fe64b-d9e0-4417-94af-2db427e4a49f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:00 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51fe64b-d9e0-4417-94af-2db427e4a49f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f Jul 15 18:51:00 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:00 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51fe64b-d9e0-4417-94af-2db427e4a49f -F qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f" returned: 0 in 0.325s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:00 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f is being set with open permissions: ugo+rw Jul 15 18:51:00 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:00 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f Jul 15 18:51:00 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:01 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f" returned: 0 in 0.268s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:01 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.info Jul 15 18:51:01 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:01 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.info" returned: 0 in 0.281s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:01 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.info is being set with open permissions: ugo+rw Jul 15 18:51:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.info {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:01 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.info Jul 15 18:51:01 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:01 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.info" returned: 0 in 0.286s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:01 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:51:01 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-19e366fc-8f07-4b61-9f90-35ff31be008e tempest-SnapshotDependencyTests-1910091545 None] Create snapshot completed successfully Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Flow 'volume_create_manager' (cc5541db-0b4d-499d-880b-755a404de516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e366834-835e-41e9-992b-80ed204e7c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e366834-835e-41e9-992b-80ed204e7c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ff0820-06fb-4b54-8393-bafed04303d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d38cfb5b90443ba8cfd065d618dee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=025400a7-e833-4c63-815b-ab86fe877b1f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:51:03Z,use_quota=True,user_id='e5ce1a1859e8456db2b21518e6412701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb986f4-8e79-4ee5-a289-8235435f209d),volume_type_id=9bb986f4-8e79-4ee5-a289-8235435f209d)' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836a3947-9077-42f9-94c3-c021041a8cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836a3947-9077-42f9-94c3-c021041a8cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73da5224-31e2-4a2a-b9b5-06f72e1ee3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73da5224-31e2-4a2a-b9b5-06f72e1ee3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54ff0820-06fb-4b54-8393-bafed04303d1', 'volume_name': 'volume-54ff0820-06fb-4b54-8393-bafed04303d1', 'volume_size': 1, 'snapshot_id': '025400a7-e833-4c63-815b-ab86fe877b1f'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b745da-36c5-4e56-bccb-4edb79768179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b745da-36c5-4e56-bccb-4edb79768179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867532de-56a5-492c-9d7a-452c0546e8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:51:03 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Volume 54ff0820-06fb-4b54-8393-bafed04303d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54ff0820-06fb-4b54-8393-bafed04303d1', 'volume_size': 1, 'snapshot_id': '025400a7-e833-4c63-815b-ab86fe877b1f'} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "cinder-quobyte-025400a7-e833-4c63-815b-ab86fe877b1f-54ff0820-06fb-4b54-8393-bafed04303d1" by "_create_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-025400a7-e833-4c63-815b-ab86fe877b1f-54ff0820-06fb-4b54-8393-bafed04303d1" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Creating volume 54ff0820-06fb-4b54-8393-bafed04303d1 from snapshot 025400a7-e833-4c63-815b-ab86fe877b1f {{(pid=87863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Selected osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c as target Quobyte volume. {{(pid=87863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "cinder-quobyte-54ff0820-06fb-4b54-8393-bafed04303d1" by "_copy_volume_from_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-54ff0820-06fb-4b54-8393-bafed04303d1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] snapshot: 025400a7-e833-4c63-815b-ab86fe877b1f, volume: 54ff0820-06fb-4b54-8393-bafed04303d1, {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb4ec79-9d5c-401b-b9f4-4d5522f98783]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:03 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f Jul 15 18:51:03 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:03 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f" returned: 0 in 0.378s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b51fe64b-d9e0-4417-94af-2db427e4a49f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Creating direct copy from snapshot {{(pid=87863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89eb75c-432f-4603-9d86-ea698033f297]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:51:03 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:04 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f Jul 15 18:51:04 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:04 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f" returned: 0 in 0.405s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:04 devstack cinder-volume[87863]: DEBUG cinder.utils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Path /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 not found in is_blk_device check {{(pid=87863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:51:04 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:04 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 Jul 15 18:51:04 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:09 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1" returned: 0 in 4.788s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:09 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ca6dec-d2e0-42cb-8be2-df4e22499daf]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:51:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:09 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f Jul 15 18:51:09 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:09 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f" returned: 0 in 0.575s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:09 devstack cinder-volume[87863]: DEBUG cinder.image.image_utils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Image conversion details: src /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 {{(pid=87863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:51:09 devstack cinder-volume[87863]: INFO cinder.image.image_utils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Converted 1024.00 MB image at 213.81 MB/s Jul 15 18:51:09 devstack cinder-volume[87863]: WARNING cinder.volume.drivers.remotefs [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 is being set with open permissions: ugo+rw Jul 15 18:51:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:09 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 Jul 15 18:51:09 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:09 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:09 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1" returned: 0 in 0.258s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-54ff0820-06fb-4b54-8393-bafed04303d1" released by "_copy_volume_from_snapshot" :: held 6.509s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:51:10 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-025400a7-e833-4c63-815b-ab86fe877b1f-54ff0820-06fb-4b54-8393-bafed04303d1" released by "_create_volume_from_snapshot" :: held 6.546s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:51:10 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.560s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:51:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867532de-56a5-492c-9d7a-452c0546e8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ff0820-06fb-4b54-8393-bafed04303d1', 'volume_size': 1, 'snapshot_id': '025400a7-e833-4c63-815b-ab86fe877b1f'}' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:51:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c683d90-12cc-41ee-a483-9e87594e5808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:51:10 devstack cinder-volume[87863]: INFO cinder.volume.flows.manager.create_volume [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Volume volume-54ff0820-06fb-4b54-8393-bafed04303d1 (54ff0820-06fb-4b54-8393-bafed04303d1): created successfully Jul 15 18:51:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c683d90-12cc-41ee-a483-9e87594e5808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:51:10 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Flow 'volume_create_manager' (cc5541db-0b4d-499d-880b-755a404de516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:51:10 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-ac811b31-0b70-4bbd-bfbf-3119543d90eb tempest-SnapshotDependencyTests-1910091545 None] Created volume successfully. Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "cinder-025400a7-e833-4c63-815b-ab86fe877b1f-delete_snapshot" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-025400a7-e833-4c63-815b-ab86fe877b1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "cinder-quobyte-b51fe64b-d9e0-4417-94af-2db427e4a49f" by "delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-b51fe64b-d9e0-4417-94af-2db427e4a49f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "cinder-quobyte-025400a7-e833-4c63-815b-ab86fe877b1f" by "_delete_snapshot" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-025400a7-e833-4c63-815b-ab86fe877b1f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Deleting offline snapshot 025400a7-e833-4c63-815b-ab86fe877b1f of volume b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] snapshot_file for this snap is: volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f {{(pid=87863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fc592a-333f-4f81-a6a4-80ff1dd3e58b]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:11 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f Jul 15 18:51:11 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:11 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f" returned: 0 in 0.372s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.remotefs [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b51fe64b-d9e0-4417-94af-2db427e4a49f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5324a97-d151-4f2f-889d-4a13d43c80db]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:51:11 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:11 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f Jul 15 18:51:11 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:12 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f" returned: 0 in 0.354s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:12 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f Jul 15 18:51:12 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:12 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f" returned: 0 in 0.346s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:12 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f Jul 15 18:51:12 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:12 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:12 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f.025400a7-e833-4c63-815b-ab86fe877b1f" returned: 0 in 0.236s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-025400a7-e833-4c63-815b-ab86fe877b1f" released by "_delete_snapshot" :: held 1.404s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:51:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-b51fe64b-d9e0-4417-94af-2db427e4a49f" released by "delete_snapshot" :: held 1.425s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:51:12 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Created reservations ['56231695-2475-45de-9bbb-c6def0705750', 'af41b800-28a7-4d24-8844-a36039f69bdf', '4d86395d-79a9-4c57-bc71-a5d34523467e', 'bd7b745a-34b2-4f6c-88d0-85c39525809e'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:51:12 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Delete snapshot completed successfully. Jul 15 18:51:12 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-08eaf930-cf50-42cf-95f1-3c2bd0c0245b tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-025400a7-e833-4c63-815b-ab86fe877b1f-delete_snapshot" released by "delete_snapshot" :: held 1.555s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:51:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "cinder-b51fe64b-d9e0-4417-94af-2db427e4a49f-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:51:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-b51fe64b-d9e0-4417-94af-2db427e4a49f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:51:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "cinder-quobyte-b51fe64b-d9e0-4417-94af-2db427e4a49f" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:51:13 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-b51fe64b-d9e0-4417-94af-2db427e4a49f" acquired by "delete_volume" :: waited 0.014s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:51:13 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d250ef59-5bb7-4c73-9d76-7d0fd599117c]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:51:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:13 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f Jul 15 18:51:13 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:13 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f" returned: 0 in 0.377s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:13 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:13 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f Jul 15 18:51:13 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:14 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-b51fe64b-d9e0-4417-94af-2db427e4a49f" returned: 0 in 0.250s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-b51fe64b-d9e0-4417-94af-2db427e4a49f" released by "delete_volume" :: held 0.685s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Created reservations ['52312342-ca84-4368-a14f-e078971daabd', 'a05b665f-be4a-4aae-98bb-13af4bf9f499', 'a54feb96-f5f6-483a-8a67-911abec1e413', 'aa161d06-6e16-441b-9f39-8112e29cc7c5'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:14 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:51:14 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:14 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.248s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:51:14 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Deleted volume successfully. Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-da2eee84-8025-4f1c-a632-f5744479832e tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-b51fe64b-d9e0-4417-94af-2db427e4a49f-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "cinder-54ff0820-06fb-4b54-8393-bafed04303d1-delete_volume" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-54ff0820-06fb-4b54-8393-bafed04303d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "cinder-quobyte-54ff0820-06fb-4b54-8393-bafed04303d1" by "delete_volume" {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-54ff0820-06fb-4b54-8393-bafed04303d1" acquired by "delete_volume" :: waited 0.015s {{(pid=87863) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16c5c2-b94b-4e5a-af9d-bac6c50f1243]: (4, 'qcow2') {{(pid=89013) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:51:14 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:14 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 Jul 15 18:51:14 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:15 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1" returned: 0 in 0.358s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:15 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1 Jul 15 18:51:15 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:15 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603/volume-54ff0820-06fb-4b54-8393-bafed04303d1" returned: 0 in 0.239s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-quobyte-54ff0820-06fb-4b54-8393-bafed04303d1" released by "delete_volume" :: held 0.634s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG cinder.quota [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Created reservations ['1cedb5ad-ea4a-4e0f-8b28-222cf53a11cd', '0a2c3a62-ef92-40c2-8ebb-857474693b31', '536e103c-faa3-4de5-9263-72a836c68ab3', 'a4be0a35-95b2-4cd0-9f65-6a813491876e'] {{(pid=87863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:15 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:51:15 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:15 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.232s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:51:15 devstack cinder-volume[87863]: INFO cinder.volume.manager [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Deleted volume successfully. Jul 15 18:51:15 devstack cinder-volume[87863]: DEBUG cinder.coordination [None req-6392f2ad-0981-4d4f-9908-aa0dd4c7d353 tempest-SnapshotDependencyTests-1910091545 None] Lock "cinder-54ff0820-06fb-4b54-8393-bafed04303d1-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87863) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:51:25 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:INSERT=18,cinder:UPDATE=62,cinder:SELECT=42,cinder:DELETE=5 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:51:25 devstack cinder-volume[87863]: DEBUG dbcounter [-] [87863] Writing DB stats cinder:UPDATE=38,cinder:SELECT=28,cinder:DELETE=4,cinder:INSERT=5 {{(pid=87863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c': None} {{(pid=87863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG cinder.volume.drivers.quobyte [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bd9da556-4c12-434f-b9a1-5e2ec88a398c'] {{(pid=87863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.lockutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:51:35 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603 Jul 15 18:51:35 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:51:35 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG oslo_concurrency.processutils [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a58615b2bcf8f38f83cd229b1047e603" returned: 0 in 0.259s {{(pid=87863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG cinder.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Notifying Schedulers of capabilities ... {{(pid=87863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG oslo_service.periodic_task [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] Running periodic task VolumeManager._thread_info {{(pid=87863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread count: 28 {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:51:35 devstack cinder-volume[87863]: DEBUG cinder.volume.manager [None req-a6d37bcb-388f-42e8-88df-cd188ae93a50 None None] thread info: [<_MainThread(MainThread, started 140142825975936)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}